00000001:02000400:1.0F:1788869421.958038:0:3291:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1788869431.686679:0:3493:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1788869432.645340:0:3556:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1319 MB/s 00000001:01000000:0.0:1788869432.895656:0:3556:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1683 MB/s 00000001:01000000:0.0:1788869433.145329:0:3556:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10875 MB/s 00000020:02000000:3.0F:1788869433.503587:0:3585:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.55_24_g1bda257 00000400:02000000:2.0:1788869433.918749:0:3600:0:(api-ni.c:2766:lnet_startup_lndni()) Added LNI 192.168.201.130@tcp [8/256/0/180] 00008000:02000000:1.0:1788869436.357520:0:3750:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788869466.192695:0:5712:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788869474.063918:0:6461:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788869474.063928:0:6461:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788869474.063930:0:6461:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788869474.064089:0:6461:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000d0b7efc8 00000080:02000400:0.0:1788869474.064102:0:6461:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788869474.070615:0:6461:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788869474.070635:0:6461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788869474.070695:0:6461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000071a3200f) 00000020:00000080:0.0:1788869474.070732:0:6461:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788869474.123524:0:6461:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788869474.123600:0:6461:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1788869474.144947:0:6461:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788869474.145173:0:6461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788869474.145182:0:6461:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788869474.145195:0:6461:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbead52e175fc2703 00000020:01000004:3.0:1788869474.145203:0:6461:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788869474.145208:0:6461:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788869474.145212:0:6461:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d0b7efc8 from MGS 00000020:01000004:3.0:1788869474.145216:0:6461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788869474.145235:0:6461:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000c74807b8) 00000020:00000080:3.0:1788869474.145245:0:6461:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788869474.145376:0:6461:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d0b7efc8 from MGS, refs=2 00080000:01000000:3.0:1788869474.145381:0:6461:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788869474.145385:0:6461:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbead52e175fc2711 00000100:00100000:3.0:1788869474.145465:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788869474.145562:0:6461:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788869474.145566:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788869474.150005:0:6461:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788869474.150017:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788869474.151700:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788869474.151846:0:6461:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788869474.151851:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788869474.152347:0:6461:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788869474.152354:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788869474.152673:0:6461:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788869474.152680:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788869474.158673:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869474.158682:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869474.158684:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869474.159011:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869474.159014:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869474.159015:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869474.159681:0:6461:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788869474.164034:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788869474.409373:0:6461:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 5011 MB/s 00000001:01000000:3.0:1788869474.659368:0:6461:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 6279 MB/s 00000001:01000000:3.0:1788869474.909678:0:6461:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1087 MB/s 00000001:01000000:0.0:1788869475.160470:0:6461:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1127 MB/s 00080000:10000000:0.0:1788869475.173745:0:6461:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1788869475.187403:0:6461:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788869475.189367:0:6475:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788869475.189418:0:6461:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788869475.189492:0:6461:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788869475.189773:0:6461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788869475.189805:0:6461:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788869475.190555:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869475.191092:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788869475.191100:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788869475.197401:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788869475.197445:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788869475.200857:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788869475.200873:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788869475.202050:0:6461:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788869475.202075:0:6461:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.130@tcp' 00000020:01000004:2.0:1788869475.202077:0:6461:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788869475.202144:0:6461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.130@tcp (typ=mgc) 00000020:00000080:2.0:1788869475.202166:0:6461:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.130@tcp (000000005139f671) 00000020:00000080:2.0:1788869475.202186:0:6461:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788869475.202378:0:6461:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b231a910@MGC192.168.201.130@tcp: add connection 192.168.201.130@tcp at head 00010000:00010000:2.0:1788869475.202555:0:6461:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.130@tcp-0 is initialized 00000040:01000000:2.0:1788869475.202563:0:6461:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788869475.203045:0:6480:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788869475.203604:0:6481:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788869475.203975:0:6461:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.130@tcp (uuid 46892796-b77d-4866-a7cc-ce4160dea4be) 00000020:00000080:0.0:1788869475.203998:0:6461:0:(genops.c:1406:class_connect()) connect: client 46892796-b77d-4866-a7cc-ce4160dea4be, cookie 0xbead52e175fc271f 00000100:00080000:0.0:1788869475.204024:0:6461:0:(import.c:510:import_select_connection()) MGC192.168.201.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788869475.204031:0:6461:0:(import.c:624:import_select_connection()) MGC192.168.201.130@tcp: import 00000000b231a910 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1788869475.204319:0:6461:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007dd31df3 x1875765554577536/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869475.204483:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007dd31df3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:46892796-b77d-4866-a7cc-ce4160dea4be:3615:1875765554577536:0@lo:250: 00000100:00100000:1.0:1788869475.204543:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869475.204586:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554577536 00000100:00100000:0.0:1788869475.204595:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554577536 00000100:00100000:0.0:1788869475.204628:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869475.204636:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013ea8f60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3615:x1875765554577536:12345-0@lo:250: 00010000:00080000:0.0:1788869475.204662:0:6476:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 46892796-b77d-4866-a7cc-ce4160dea4be@0@lo t0 exp 0000000000000000 cur 93 last 0 00000100:00080000:1.0:1788869475.204664:0:6461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 46892796-b77d-4866-a7cc-ce4160dea4be->MGS 00000020:01000004:1.0:1788869475.204682:0:6461:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:00000080:0.0:1788869475.204686:0:6476:0:(genops.c:1406:class_connect()) connect: client 46892796-b77d-4866-a7cc-ce4160dea4be, cookie 0xbead52e175fc2726 00000020:01000004:1.0:1788869475.204688:0:6461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788869475.204708:0:6461:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000c70871eb) 00000020:00000080:1.0:1788869475.204720:0:6461:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:0.0:1788869475.204941:0:6476:0:(import.c:65:import_set_state_nolock()) 0000000061dd7cf0 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869475.204998:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013ea8f60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+5:3615:x1875765554577536:12345-0@lo:250: Request processed in 362us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869475.205006:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869475.205075:0:3615:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788869475.205096:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.130@tcp: connect to target with instance 0 00000100:00080000:0.0:1788869475.205104:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788869475.205109:0:3615:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788869475.205111:0:3615:0:(import.c:65:import_set_state_nolock()) 00000000b231a910 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788869475.205114:0:3615:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788869475.205127:0:3615:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788869475.205132:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007dd31df3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:46892796-b77d-4866-a7cc-ce4160dea4be:3615:1875765554577536:0@lo:250: 00010000:00010000:3.0:1788869475.225285:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869475.241566:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869475.241834:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788869475.241842:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788869475.243473:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788869475.243483:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788869475.243951:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788869475.243958:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788869475.248703:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788869475.248903:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788869475.248909:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788869475.250461:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788869475.250472:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788869475.295401:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788869475.295676:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788869475.295682:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788869475.296827:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788869475.296834:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788869475.297401:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788869475.297652:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788869475.297655:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788869475.298026:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788869475.298038:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788869475.298731:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788869475.298809:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788869475.298816:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788869475.300680:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788869475.300691:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788869475.301728:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788869475.301932:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788869475.301938:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788869475.303650:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788869475.303661:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788869475.326830:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788869475.327066:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788869475.327073:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788869475.328865:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788869475.328877:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788869475.330647:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788869475.330659:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788869475.332010:0:6461:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788869475.332039:0:6461:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788869475.332047:0:6461:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788869475.332180:0:6461:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788869475.332218:0:6461:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.130@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788869475.332222:0:6461:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788869475.332224:0:6461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788869475.332225:0:6461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869475.332226:0:6461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869475.332227:0:6461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869475.332228:0:6461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869475.332229:0:6461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788869475.332230:0:6461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788869475.332231:0:6461:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788869475.332232:0:6461:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788869475.332233:0:6461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869475.332234:0:6461:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788869475.332236:0:6461:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788869475.332238:0:6461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788869475.332238:0:6461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788869475.332239:0:6461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869475.332240:0:6461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869475.332240:0:6461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869475.332241:0:6461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869475.332241:0:6461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788869475.332242:0:6461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788869475.332246:0:6461:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788869475.332246:0:6461:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788869475.332247:0:6461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869475.332247:0:6461:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788869475.332311:0:6461:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788869475.332333:0:6461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002eeadab6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554577664:0@lo:253: 00000100:00100000:2.0:1788869475.332425:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869475.332574:0:6461:0:(client.c:2702:ptlrpc_set_wait()) set 0000000099f1d78c going to sleep for 11 seconds 00000100:00100000:3.0:1788869475.332984:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554577664 00000100:00100000:3.0:1788869475.332992:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554577664 00000100:00100000:3.0:1788869475.333034:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869475.333040:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9d13b84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+5:6461:x1875765554577664:12345-0@lo:253: 20000000:01000000:3.0:1788869475.333098:0:6479:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788869475.333105:0:6479:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788869475.333467:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788869475.333534:0:6479:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788869475.333849:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869475.334637:0:6501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788869475.335783:0:6479:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788869475.335788:0:6479:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788869475.335795:0:6479:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788869475.335799:0:6479:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788869475.335812:0:6479:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788869475.335999:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788869475.336173:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788869475.336189:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788869475.336206:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788869475.336225:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788869475.336241:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788869475.336334:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788869475.336352:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788869475.336370:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788869475.336379:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788869475.336393:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788869475.336398:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788869475.336411:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788869475.336427:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788869475.336455:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788869475.336461:0:6479:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788869475.336467:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788869475.336575:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788869475.336585:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788869475.336599:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788869475.336614:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788869475.336629:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788869475.336638:0:6479:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788869475.336664:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788869475.336671:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788869475.336683:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788869475.336709:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788869475.336724:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788869475.336733:0:6479:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788869475.336755:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788869475.336762:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788869475.336774:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788869475.336787:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788869475.336850:0:6479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788869475.336876:0:6479:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788869475.336883:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788869475.337191:0:6502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788869475.337315:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788869475.337341:0:6479:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.130@tcp for mdt 20000000:01000000:2.0:1788869475.337343:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.130@tcp (null) (null) (null) 00000040:00080000:2.0:1788869475.337357:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788869475.337362:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788869475.337373:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788869475.337379:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.130@tcp (null) (null) 00000040:00080000:2.0:1788869475.337391:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788869475.337399:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788869475.337411:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788869475.337432:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788869475.337523:0:6479:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788869475.337525:0:6479:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788869475.337529:0:6479:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788869475.337580:0:6479:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788869475.337581:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788869475.337785:0:6503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788869475.337875:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788869475.337895:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788869475.337910:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1788869475.337921:0:6479:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788869475.337922:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788869475.338129:0:6504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788869475.338207:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788869475.338226:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788869475.338240:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1788869475.338248:0:6479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788869475.338292:0:6479:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788869475.338296:0:6479:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788869475.338299:0:6479:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788869475.338312:0:6479:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788869475.338320:0:6479:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788869475.338638:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788869475.338687:0:6479:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788869475.345140:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788869475.345185:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788869475.345198:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788869475.345221:0:6479:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788869475.345580:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005c38073e/0xbead52e175fc2734 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.345602:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005c38073e/0xbead52e175fc2734 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.345614:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005c38073e/0xbead52e175fc2734 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.345621:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005c38073e/0xbead52e175fc2734 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.345649:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005c38073e/0xbead52e175fc2734 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.345657:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005c38073e/0xbead52e175fc2734 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.345664:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005c38073e already unused, calling callback (000000000b2a4490) 00010000:00010000:3.0:1788869475.345668:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005c38073e/0xbead52e175fc2734 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.345676:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005c38073e/0xbead52e175fc2734 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.345692:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005c38073e/0xbead52e175fc2734 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.345701:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005c38073e/0xbead52e175fc2734 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.345708:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005c38073e/0xbead52e175fc2734 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788869475.345731:0:6479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788869475.353916:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9d13b84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+5:6461:x1875765554577664:12345-0@lo:253: Request processed in 20865us (21482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869475.353940:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869475.356195:0:6461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002eeadab6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554577664:0@lo:253: 10000000:01000000:0.0:1788869475.356219:0:6461:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788869475.356223:0:6461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788869475.356225:0:6461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788869475.356227:0:6461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788869475.356228:0:6461:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788869475.356229:0:6461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788869475.356231:0:6461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788869475.356232:0:6461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788869475.356233:0:6461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788869475.356235:0:6461:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788869475.356237:0:6461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788869475.356239:0:6461:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788869475.356305:0:6461:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d0b7efc8 from lustre-MDT0000 10000000:01000000:0.0:1788869475.356374:0:6461:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788869475.356385:0:6461:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788869475.356390:0:6461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99ff8b770000 10000000:01000000:0.0:1788869475.356395:0:6461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788869475.356403:0:6461:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99ff8b770000 from 1 10000000:01000000:0.0:1788869475.356407:0:6461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788869475.356466:0:6461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc273b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869475.356479:0:6461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc273b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869475.356488:0:6461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc273b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869475.356510:0:6461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d7c43ddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554577792:0@lo:101: 00000100:00100000:0.0:1788869475.356578:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869475.356623:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554577792 00000100:00100000:2.0:1788869475.356631:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554577792 00000100:00100000:0.0:1788869475.356632:0:6461:0:(client.c:2702:ptlrpc_set_wait()) set 0000000008108245 going to sleep for 11 seconds 00000100:00100000:2.0:1788869475.356673:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869475.356681:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5f80461 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+5:6461:x1875765554577792:12345-0@lo:101: 00010000:00010000:2.0:1788869475.356694:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869475.356708:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000705a0d9f/0xbead52e175fc2742 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc273b expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869475.356730:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000705a0d9f/0xbead52e175fc2742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc273b expref: 6 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869475.356737:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000705a0d9f/0xbead52e175fc2742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc273b expref: 6 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869475.356745:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000705a0d9f, rc 0) 00000100:00100000:2.0:1788869475.356824:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5f80461 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+6:6461:x1875765554577792:12345-0@lo:101: Request processed in 145us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869475.356829:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869475.356874:0:6461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d7c43ddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554577792:0@lo:101: 00010000:00010000:0.0:1788869475.356885:0:6461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc273b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2742 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869475.356892:0:6461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc273b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2742 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869475.356945:0:6461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d7c43ddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554577920:0@lo:501: 00000100:00100000:0.0:1788869475.356962:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869475.356999:0:6461:0:(client.c:2702:ptlrpc_set_wait()) set 0000000008108245 going to sleep for 11 seconds 00000100:00100000:2.0:1788869475.357027:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554577920 00000100:00100000:2.0:1788869475.357034:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554577920 00000100:00100000:2.0:1788869475.357094:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788869475.357098:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d49478b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+6:6461:x1875765554577920:12345-0@lo:501: 00000100:00100000:2.0:1788869475.357171:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d49478b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+6:6461:x1875765554577920:12345-0@lo:501: Request processed in 74us (209us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788869475.357176:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869475.357224:0:6461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d7c43ddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554577920:0@lo:501: 10000000:01000000:1.0:1788869475.357249:0:6461:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788869475.357279:0:6461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc273b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2742 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869475.357285:0:6461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc273b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2742 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869475.357290:0:6461:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ff8b15e800 10000000:01000000:1.0:1788869475.357293:0:6461:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788869475.357296:0:6461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99ff8b15e800 10000000:01000000:1.0:1788869475.357297:0:6461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788869475.357307:0:6461:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99ff8b15e800 from 1 10000000:01000000:1.0:1788869475.357309:0:6461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788869475.357323:0:6461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 00000000ec999752/0xbead52e175fc2749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869475.357327:0:6461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 00000000ec999752/0xbead52e175fc2749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869475.357332:0:6461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 00000000ec999752/0xbead52e175fc2749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869475.357339:0:6461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087b04400 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554578048:0@lo:101: 00000100:00100000:1.0:1788869475.357361:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869475.357638:0:6461:0:(client.c:2702:ptlrpc_set_wait()) set 0000000026085a7f going to sleep for 11 seconds 00000100:00100000:0.0:1788869475.357677:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554578048 00000100:00100000:0.0:1788869475.357681:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554578048 00000100:00100000:0.0:1788869475.357712:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788869475.357726:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094c391c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+6:6461:x1875765554578048:12345-0@lo:101: 00010000:00010000:0.0:1788869475.357735:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869475.357746:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ab8ffb40/0xbead52e175fc2750 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2749 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869475.357761:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab8ffb40/0xbead52e175fc2750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2749 expref: 7 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869475.357770:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ab8ffb40/0xbead52e175fc2750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2749 expref: 7 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869475.357777:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ab8ffb40, rc 0) 00000100:00100000:0.0:1788869475.357813:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094c391c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+7:6461:x1875765554578048:12345-0@lo:101: Request processed in 89us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869475.357819:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788869475.357902:0:6461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087b04400 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554578048:0@lo:101: 00010000:00010000:1.0:1788869475.357912:0:6461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 00000000ec999752/0xbead52e175fc2749 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2750 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869475.357920:0:6461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 00000000ec999752/0xbead52e175fc2749 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2750 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869475.357942:0:6461:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788869475.357959:0:6461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 00000000ec999752/0xbead52e175fc2749 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2750 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869475.357965:0:6461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 00000000ec999752/0xbead52e175fc2749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2750 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869475.357972:0:6461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788869475.357975:0:6461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788869475.357979:0:6461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99ff8b15e800 10000000:01000000:1.0:1788869475.357982:0:6461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788869475.357985:0:6461:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788869475.357987:0:6461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788869475.357998:0:6461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 00000000e8e667c7/0xbead52e175fc2757 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869475.358002:0:6461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 00000000e8e667c7/0xbead52e175fc2757 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869475.358006:0:6461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 00000000e8e667c7/0xbead52e175fc2757 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869475.358013:0:6461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087b04400 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554578176:0@lo:101: 00000100:00100000:1.0:1788869475.358031:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869475.358048:0:6461:0:(client.c:2702:ptlrpc_set_wait()) set 0000000026085a7f going to sleep for 11 seconds 00000100:00100000:0.0:1788869475.358140:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554578176 00000100:00100000:0.0:1788869475.358143:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554578176 00000100:00100000:0.0:1788869475.358164:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869475.358167:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbe4d5fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+7:6461:x1875765554578176:12345-0@lo:101: 00010000:00010000:0.0:1788869475.358172:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869475.358177:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cc3e9845/0xbead52e175fc275e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2757 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869475.358186:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cc3e9845/0xbead52e175fc275e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2757 expref: 8 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869475.358191:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cc3e9845/0xbead52e175fc275e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2757 expref: 8 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869475.358195:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cc3e9845, rc 0) 00000100:00100000:0.0:1788869475.358218:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbe4d5fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+8:6461:x1875765554578176:12345-0@lo:101: Request processed in 51us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869475.358222:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869475.358277:0:6461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087b04400 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554578176:0@lo:101: 00010000:00010000:1.0:1788869475.358284:0:6461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 00000000e8e667c7/0xbead52e175fc2757 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc275e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869475.358296:0:6461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 00000000e8e667c7/0xbead52e175fc2757 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc275e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869475.358424:0:6461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087b04400 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554578304:0@lo:501: 00000100:00100000:1.0:1788869475.358442:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869475.358466:0:6461:0:(client.c:2702:ptlrpc_set_wait()) set 0000000026085a7f going to sleep for 11 seconds 00000100:00100000:0.0:1788869475.358516:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554578304 00000100:00100000:0.0:1788869475.358520:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554578304 00000100:00100000:0.0:1788869475.358544:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788869475.358547:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008de8db6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+8:6461:x1875765554578304:12345-0@lo:501: 00000100:00100000:0.0:1788869475.358635:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008de8db6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+9:6461:x1875765554578304:12345-0@lo:501: Request processed in 87us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869475.358639:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788869475.358692:0:6461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087b04400 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554578304:0@lo:501: 00000100:00100000:1.0:1788869475.358711:0:6461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087b04400 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554578432:0@lo:503: 00000100:00100000:1.0:1788869475.358740:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869475.358756:0:6461:0:(client.c:2702:ptlrpc_set_wait()) set 0000000026085a7f going to sleep for 11 seconds 00000100:00100000:0.0:1788869475.358873:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554578432 00000100:00100000:0.0:1788869475.358876:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554578432 00000100:00100000:0.0:1788869475.358889:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788869475.358892:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005978ca28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+9:6461:x1875765554578432:12345-0@lo:503: 00000100:00100000:0.0:1788869475.358960:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005978ca28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+9:6461:x1875765554578432:12345-0@lo:503: Request processed in 67us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869475.358964:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788869475.359041:0:6461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087b04400 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554578432:0@lo:503: 00000100:00100000:2.0:1788869475.359506:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000034c0e10d pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:6506:1875765554578560:0@lo:502: 00000100:00100000:2.0:1788869475.359534:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869475.359558:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c52c529a going to sleep for 11 seconds 00000100:00100000:0.0:1788869475.359571:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554578560 00000100:00100000:0.0:1788869475.359575:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554578560 00000100:00100000:0.0:1788869475.359637:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788869475.359643:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7f721d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+9:6506:x1875765554578560:12345-0@lo:502: 00000100:00100000:0.0:1788869475.359715:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7f721d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+9:6506:x1875765554578560:12345-0@lo:502: Request processed in 73us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869475.359721:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869475.359737:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000034c0e10d pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:6506:1875765554578560:0@lo:502: 00000020:01000000:2.0:1788869475.359757:0:6506:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869475.359770:0:6506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869475.359773:0:6506:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788869475.359778:0:6506:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788869475.359781:0:6506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788869475.359797:0:6506:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000d1f15ae4) 00000020:00000080:2.0:1788869475.359825:0:6506:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788869475.359832:0:6506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788869475.359910:0:6506:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788869475.359915:0:6506:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbead52e175fc276c 00000020:00000080:2.0:1788869475.360127:0:6506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788869475.360130:0:6506:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869475.360133:0:6506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869475.360134:0:6506:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788869475.360136:0:6506:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869475.360138:0:6506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869475.360139:0:6506:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788869475.360141:0:6506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788869475.360147:0:6506:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000001d11efb7) 00000020:00000080:2.0:1788869475.360155:0:6506:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788869475.360161:0:6506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788869475.360163:0:6506:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788869475.360165:0:6506:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788869475.360169:0:6506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788869475.360200:0:6506:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d0b7efc8 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788869475.360210:0:6506:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000034d4d4ed) 00000020:00000080:2.0:1788869475.360215:0:6506:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788869475.360326:0:6506:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788869475.360332:0:6506:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbead52e175fc2781 00000020:00000080:2.0:1788869475.360632:0:6506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788869475.360639:0:6506:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788869475.360643:0:6506:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbead52e175fc2788 00080000:01000000:2.0:1788869475.360646:0:6506:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788869475.360648:0:6506:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbead52e175fc278f 00080000:10000000:2.0:1788869475.361068:0:6506:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788869475.361209:0:6506:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788869475.363795:0:6506:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788869475.404919:0:6506:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788869475.405364:0:6506:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788869475.406787:0:6506:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788869475.407107:0:6506:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788869475.409066:0:6506:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000758d8bb6) 00000020:00000080:3.0:1788869475.409100:0:6506:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788869475.409180:0:6506:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788869475.409193:0:6506:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbead52e175fc279d 00000020:00000080:3.0:1788869475.415144:0:6506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788869475.416809:0:6506:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1788869475.419647:0:6506:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1788869475.422719:0:6506:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1788869475.425029:0:6506:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1788869475.427238:0:6506:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1788869475.431936:0:6506:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1788869475.435874:0:6506:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbead52e175fc27a4 00000020:00000080:0.0:1788869475.436862:0:6506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788869475.436878:0:6506:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869475.436887:0:6506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869475.436889:0:6506:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788869475.436902:0:6506:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869475.436907:0:6506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869475.436909:0:6506:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788869475.436912:0:6506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788869475.436914:0:6506:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788869475.436917:0:6506:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869475.436920:0:6506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869475.436921:0:6506:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788869475.436923:0:6506:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869475.436928:0:6506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869475.436930:0:6506:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788869475.436934:0:6506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788869475.436992:0:6506:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788869475.437069:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006f9b8132 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:6506:1875765554578688:0@lo:502: 00000100:00100000:0.0:1788869475.437187:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869475.437247:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554578688 00000100:00100000:0.0:1788869475.437248:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c52c529a going to sleep for 11 seconds 00000100:00100000:2.0:1788869475.437284:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554578688 00000100:00100000:2.0:1788869475.437404:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788869475.437414:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000acb5e228 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+9:6506:x1875765554578688:12345-0@lo:502: 00000100:00100000:2.0:1788869475.437552:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000acb5e228 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+9:6506:x1875765554578688:12345-0@lo:502: Request processed in 139us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869475.437561:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788869475.438552:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006f9b8132 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:6506:1875765554578688:0@lo:502: 00000020:01000000:0.0:1788869475.438590:0:6506:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869475.438599:0:6506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869475.438602:0:6506:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1788869475.438606:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788869475.439678:0:6461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788869475.439710:0:6461:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788869475.439731:0:6461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 00000000e8e667c7/0xbead52e175fc2757 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc275e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.439744:0:6461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 00000000e8e667c7/0xbead52e175fc2757 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc275e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869475.439752:0:6461:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ff8b15e800 from 1 10000000:01000000:3.0:1788869475.439756:0:6461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788869475.439820:0:6461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 00000000215c4be7/0xbead52e175fc27ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.439829:0:6461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 00000000215c4be7/0xbead52e175fc27ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.439839:0:6461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 00000000215c4be7/0xbead52e175fc27ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869475.439862:0:6461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000083268b13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554578816:0@lo:101: 00000100:00100000:3.0:1788869475.440876:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869475.440940:0:6461:0:(client.c:2702:ptlrpc_set_wait()) set 00000000479d1e2a going to sleep for 11 seconds 00000100:00100000:0.0:1788869475.441027:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554578816 00000100:00100000:0.0:1788869475.441036:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554578816 00000100:00100000:0.0:1788869475.441097:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788869475.441107:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091eab03e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+9:6461:x1875765554578816:12345-0@lo:101: 00010000:00010000:0.0:1788869475.441124:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869475.441146:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000016328a5e/0xbead52e175fc27b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc27ab expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869475.441178:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000016328a5e/0xbead52e175fc27b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc27ab expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869475.441199:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000016328a5e/0xbead52e175fc27b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc27ab expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869475.441210:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000016328a5e, rc 0) 00000100:00100000:0.0:1788869475.441660:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091eab03e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+10:6461:x1875765554578816:12345-0@lo:101: Request processed in 554us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869475.441668:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869475.441763:0:6461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000083268b13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554578816:0@lo:101: 00010000:00010000:3.0:1788869475.441782:0:6461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 00000000215c4be7/0xbead52e175fc27ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc27b2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.441792:0:6461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 00000000215c4be7/0xbead52e175fc27ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc27b2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869475.442846:0:6461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000083268b13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554578944:0@lo:256: 00000100:00100000:3.0:1788869475.442911:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869475.442989:0:6461:0:(client.c:2702:ptlrpc_set_wait()) set 00000000479d1e2a going to sleep for 11 seconds 00000100:00100000:1.0:1788869475.443028:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554578944 00000100:00100000:1.0:1788869475.443036:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554578944 00000100:00100000:1.0:1788869475.443074:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788869475.443090:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee101be6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+10:6461:x1875765554578944:12345-0@lo:256: 20000000:01000000:1.0:1788869475.443113:0:6476:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788869475.443120:0:6476:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788869475.443531:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee101be6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+10:6461:x1875765554578944:12345-0@lo:256: Request processed in 442us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869475.443539:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869475.443600:0:6461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000083268b13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554578944:0@lo:256: 10000000:01000000:3.0:1788869475.444182:0:6461:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788869475.444210:0:6461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 00000000215c4be7/0xbead52e175fc27ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc27b2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.444222:0:6461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 00000000215c4be7/0xbead52e175fc27ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc27b2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869475.444230:0:6461:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ff8b15e800 from 1 10000000:01000000:3.0:1788869475.444233:0:6461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788869475.444979:0:6461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 000000006c3dfd5c/0xbead52e175fc27b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.444992:0:6461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 000000006c3dfd5c/0xbead52e175fc27b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.445002:0:6461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 000000006c3dfd5c/0xbead52e175fc27b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869475.445038:0:6461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000083268b13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554579072:0@lo:101: 00000100:00100000:3.0:1788869475.445106:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869475.445148:0:6461:0:(client.c:2702:ptlrpc_set_wait()) set 00000000479d1e2a going to sleep for 11 seconds 00000100:00100000:0.0:1788869475.445205:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554579072 00000100:00100000:0.0:1788869475.445212:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554579072 00000100:00100000:0.0:1788869475.445295:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788869475.445460:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3b7651c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+10:6461:x1875765554579072:12345-0@lo:101: 00010000:00010000:0.0:1788869475.445475:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869475.445491:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000df91d8e/0xbead52e175fc27c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc27b9 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869475.445518:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000df91d8e/0xbead52e175fc27c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc27b9 expref: 11 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869475.445527:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000df91d8e/0xbead52e175fc27c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc27b9 expref: 11 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869475.445536:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000df91d8e, rc 0) 00000100:00100000:0.0:1788869475.445582:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3b7651c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+11:6461:x1875765554579072:12345-0@lo:101: Request processed in 126us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869475.445589:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788869475.446022:0:6461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000083268b13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554579072:0@lo:101: 00010000:00010000:1.0:1788869475.446041:0:6461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 000000006c3dfd5c/0xbead52e175fc27b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc27c0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869475.446051:0:6461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 000000006c3dfd5c/0xbead52e175fc27b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc27c0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869475.446148:0:6461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008e419585 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554579200:0@lo:501: 00000100:00100000:1.0:1788869475.446179:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869475.446209:0:6461:0:(client.c:2702:ptlrpc_set_wait()) set 000000002a03c71c going to sleep for 11 seconds 00000100:00100000:2.0:1788869475.446245:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554579200 00000100:00100000:2.0:1788869475.446274:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554579200 00000100:00100000:2.0:1788869475.446309:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788869475.446321:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2ac3a9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+11:6461:x1875765554579200:12345-0@lo:501: 00000100:00100000:2.0:1788869475.446612:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2ac3a9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+11:6461:x1875765554579200:12345-0@lo:501: Request processed in 296us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869475.446628:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788869475.446715:0:6461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008e419585 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554579200:0@lo:501: 00000100:00100000:1.0:1788869475.446744:0:6461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008e419585 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554579328:0@lo:503: 00000100:00100000:1.0:1788869475.446788:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869475.446809:0:6461:0:(client.c:2702:ptlrpc_set_wait()) set 000000002a03c71c going to sleep for 11 seconds 00000100:00100000:0.0:1788869475.446825:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554579328 00000100:00100000:0.0:1788869475.446830:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554579328 00000100:00100000:0.0:1788869475.446892:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788869475.446905:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa3004cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+11:6461:x1875765554579328:12345-0@lo:503: 00000040:00080000:0.0:1788869475.446942:0:6478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788869475.446987:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa3004cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+11:6461:x1875765554579328:12345-0@lo:503: Request processed in 83us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869475.446994:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788869475.447012:0:6461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008e419585 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554579328:0@lo:503: 00000040:00080000:3.0:1788869475.448522:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788869475.449554:0:6461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788869475.449577:0:6461:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869475.449592:0:6461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 000000006c3dfd5c/0xbead52e175fc27b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc27c0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869475.449603:0:6461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 000000006c3dfd5c/0xbead52e175fc27b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc27c0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869475.449649:0:6461:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788869475.449652:0:6461:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ff8b15e800 10000000:01000000:1.0:1788869475.449654:0:6461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ff8b15e800 10000000:01000000:1.0:1788869475.449658:0:6461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788869475.449662:0:6461:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ff8b15e800 from 1 10000000:01000000:1.0:1788869475.449664:0:6461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788869475.449695:0:6461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 0000000008e31d89/0xbead52e175fc27c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869475.449701:0:6461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 0000000008e31d89/0xbead52e175fc27c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869475.449724:0:6461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 0000000008e31d89/0xbead52e175fc27c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869475.449742:0:6461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008e419585 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554579456:0@lo:101: 00000100:00100000:1.0:1788869475.449807:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869475.449850:0:6461:0:(client.c:2702:ptlrpc_set_wait()) set 000000009dbcc5d3 going to sleep for 11 seconds 00000100:00100000:3.0:1788869475.449858:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554579456 00000100:00100000:3.0:1788869475.449866:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554579456 00000100:00100000:3.0:1788869475.449956:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788869475.449966:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0bb7157 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+11:6461:x1875765554579456:12345-0@lo:101: 00010000:00010000:3.0:1788869475.449987:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869475.450002:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000095cc9e2a/0xbead52e175fc27ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc27c7 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.450030:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000095cc9e2a/0xbead52e175fc27ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc27c7 expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.450041:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000095cc9e2a/0xbead52e175fc27ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc27c7 expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.450050:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000095cc9e2a, rc 0) 00000100:00100000:3.0:1788869475.450103:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0bb7157 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+12:6461:x1875765554579456:12345-0@lo:101: Request processed in 139us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869475.450111:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788869475.451229:0:6461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008e419585 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554579456:0@lo:101: 00010000:00010000:1.0:1788869475.451266:0:6461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 0000000008e31d89/0xbead52e175fc27c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc27ce expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869475.451278:0:6461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 0000000008e31d89/0xbead52e175fc27c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc27ce expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869475.451376:0:6461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008e419585 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554579584:0@lo:501: 00000100:00100000:1.0:1788869475.451417:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869475.451612:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554579584 00000100:00100000:3.0:1788869475.451617:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554579584 00000100:00100000:1.0:1788869475.451620:0:6461:0:(client.c:2702:ptlrpc_set_wait()) set 000000009dbcc5d3 going to sleep for 11 seconds 00000100:00100000:3.0:1788869475.451650:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788869475.451656:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9979d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+12:6461:x1875765554579584:12345-0@lo:501: 00000100:00100000:3.0:1788869475.451771:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9979d29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+12:6461:x1875765554579584:12345-0@lo:501: Request processed in 115us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869475.451781:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788869475.451805:0:6461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008e419585 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554579584:0@lo:501: 00000100:00100000:1.0:1788869475.451834:0:6461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008e419585 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554579712:0@lo:503: 00000100:00100000:1.0:1788869475.451874:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869475.451894:0:6461:0:(client.c:2702:ptlrpc_set_wait()) set 000000009dbcc5d3 going to sleep for 11 seconds 00000100:00100000:3.0:1788869475.452423:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554579712 00000100:00100000:3.0:1788869475.452428:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554579712 00000100:00100000:3.0:1788869475.452470:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788869475.452477:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000222f90cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+12:6461:x1875765554579712:12345-0@lo:503: 00000100:00100000:2.0:1788869475.452654:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000222f90cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+12:6461:x1875765554579712:12345-0@lo:503: Request processed in 177us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869475.452662:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788869475.452746:0:6461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008e419585 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554579712:0@lo:503: 00000100:00100000:1.0:1788869475.453390:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008e419585 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:6511:1875765554579840:0@lo:502: 00000100:00100000:1.0:1788869475.453432:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869475.453461:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cdb3478c going to sleep for 11 seconds 00000100:00100000:3.0:1788869475.453516:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554579840 00000100:00100000:3.0:1788869475.453521:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554579840 00000100:00100000:3.0:1788869475.453555:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788869475.453561:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000475f3742 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+12:6511:x1875765554579840:12345-0@lo:502: 00000100:00100000:3.0:1788869475.453649:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000475f3742 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+12:6511:x1875765554579840:12345-0@lo:502: Request processed in 88us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869475.453656:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788869475.453766:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008e419585 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:6511:1875765554579840:0@lo:502: 00000020:01000004:1.0:1788869475.453834:0:6511:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788869475.453852:0:6511:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000d576e007) 00000020:00000080:1.0:1788869475.453872:0:6511:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788869475.454197:0:6511:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d0b7efc8 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788869475.454202:0:6511:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d0b7efc8 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788869475.454205:0:6511:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000d0b7efc8 4 00010000:00080000:1.0:1788869475.454233:0:6511:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005b3fcdac@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:1.0:1788869475.457925:0:6511:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788869475.458044:0:6511:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788869475.461047:0:6511:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788869475.461068:0:6511:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbead52e175fc27dc 00000100:00080000:1.0:1788869475.461092:0:6511:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788869475.461099:0:6511:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005b3fcdac using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1788869475.461163:0:6511:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008e419585 x1875765554579968/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788869475.461190:0:6511:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788869475.461229:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008e419585 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875765554579968:0@lo:38: 00000100:00100000:0.0:1788869475.461375:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869475.461420:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554579968 00000100:00100000:2.0:1788869475.461430:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554579968 00000100:00100000:2.0:1788869475.461470:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869475.461477:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f9b8132 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3615:x1875765554579968:12345-0@lo:38: 00000100:00100000:2.0:1788869475.461549:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f9b8132 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3615:x1875765554579968:12345-0@lo:38: Request processed in 70us (184us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788869475.461556:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869475.461635:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788869475.461645:0:3615:0:(import.c:65:import_set_state_nolock()) 000000005b3fcdac lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869475.461650:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788869475.461654:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008e419585 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875765554579968:0@lo:38: 00000100:00100000:3.0:1788869475.462383:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000056965570 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:6511:1875765554580096:0@lo:502: 00000100:00100000:3.0:1788869475.462434:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869475.462467:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c68410fb going to sleep for 11 seconds 00000100:00100000:0.0:1788869475.462514:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554580096 00000100:00100000:0.0:1788869475.462520:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554580096 00000100:00100000:0.0:1788869475.462572:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788869475.462580:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9034d03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+12:6511:x1875765554580096:12345-0@lo:502: 00000100:00100000:0.0:1788869475.462738:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9034d03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+12:6511:x1875765554580096:12345-0@lo:502: Request processed in 160us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869475.462746:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788869475.463018:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000056965570 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:6511:1875765554580096:0@lo:502: 00000040:00080000:1.0:1788869475.463046:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1788869475.463147:0:6461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788869475.463172:0:6461:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788869475.463198:0:6461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 0000000008e31d89/0xbead52e175fc27c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc27ce expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.463209:0:6461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 0000000008e31d89/0xbead52e175fc27c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc27ce expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788869475.463291:0:6461:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788869475.463293:0:6461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788869475.463295:0:6461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869475.463296:0:6461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869475.463308:0:6461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869475.463315:0:6461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869475.463317:0:6461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788869475.463319:0:6461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788869475.463320:0:6461:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788869475.463322:0:6461:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788869475.463324:0:6461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869475.463326:0:6461:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788869475.463330:0:6461:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788869475.463332:0:6461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788869475.463333:0:6461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788869475.463335:0:6461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869475.463336:0:6461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869475.463337:0:6461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869475.463338:0:6461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869475.463340:0:6461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788869475.463340:0:6461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788869475.463341:0:6461:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788869475.463342:0:6461:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788869475.463343:0:6461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869475.463344:0:6461:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788869475.463361:0:6461:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788869475.463382:0:6461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000070d47225 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554580224:0@lo:253: 00000100:00100000:3.0:1788869475.463423:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869475.463470:0:6461:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cefe0905 going to sleep for 11 seconds 00000100:00100000:1.0:1788869475.464006:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554580224 00000100:00100000:1.0:1788869475.464013:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554580224 00000100:00100000:1.0:1788869475.464049:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788869475.464057:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094c71804 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+12:6461:x1875765554580224:12345-0@lo:253: 20000000:01000000:1.0:1788869475.464093:0:6479:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788869475.464110:0:6479:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788869475.469708:0:6479:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788869475.469733:0:6479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788869475.469844:0:6500:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788869475.469850:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788869475.469875:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003665a10c/0xbead52e175fc27e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.469898:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000016328a5e/0xbead52e175fc27b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc27ab expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.469906:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003665a10c/0xbead52e175fc27e3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.469954:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000016328a5e/0xbead52e175fc27b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc27ab expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.469980:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000016328a5e/0xbead52e175fc27b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc27ab expref: 12 pid: 6478 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869475.469998:0:6500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000c314522 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1875765554580352:0@lo:104: 00000100:00100000:0.0:1788869475.470280:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094c71804 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+12:6461:x1875765554580224:12345-0@lo:253: Request processed in 6223us (6857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869475.470289:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788869475.470326:0:6461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000070d47225 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:6461:1875765554580224:0@lo:253: 00000100:00100000:3.0:1788869475.470364:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869475.470396:0:6500:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c622e55e going to sleep for 11 seconds 00000100:00100000:3.0:1788869475.470420:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554580352 00000100:00100000:3.0:1788869475.470426:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554580352 10000000:01000000:2.0:1788869475.470448:0:6461:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788869475.470454:0:6461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788869475.470460:0:6461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788869475.470462:0:6461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869475.470463:0:6461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869475.470464:0:6461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869475.470466:0:6461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869475.470467:0:6461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788869475.470469:0:6461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788869475.470471:0:6461:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788869475.470472:0:6461:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788869475.470475:0:6461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869475.470476:0:6461:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788869475.470479:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869475.470490:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e99d99c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+3:6500:x1875765554580352:12345-0@lo:104: 00000020:02000000:2.0:1788869475.470499:0:6461:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788869475.470505:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: 00000000215c4be7/0xbead52e175fc27ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc27b2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.470557:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788869475.470562:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e99d99c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+3:6500:x1875765554580352:12345-0@lo:104: Request processed in 75us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869475.470568:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869475.470593:0:6500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000c314522 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1875765554580352:0@lo:104: 00010000:00010000:3.0:1788869475.470604:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003665a10c/0xbead52e175fc27e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.471810:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869475.471818:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: 00000000215c4be7/0xbead52e175fc27ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc27b2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.471829:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000215c4be7 already unused, calling callback (00000000cb5a5c96) 10000000:00010000:3.0:1788869475.471833:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: 00000000215c4be7/0xbead52e175fc27ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc27b2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.471853:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: 00000000215c4be7/0xbead52e175fc27ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc27b2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869475.471860:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: 00000000215c4be7/0xbead52e175fc27ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc27b2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869475.471865:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788869475.471910:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: 00000000215c4be7/0xbead52e175fc27ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc27b2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.471917:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869475.471952:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: 00000000215c4be7/0xbead52e175fc27ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc27b2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.471960:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: 00000000215c4be7/0xbead52e175fc27ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc27b2 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.471977:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869475.471979:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869475.471981:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869475.472036:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000c314522 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554580480:0@lo:103: 00000100:00100000:1.0:1788869475.472099:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869475.472151:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554580480 00000100:00100000:3.0:1788869475.472158:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554580480 00010000:00010000:3.0:1788869475.472179:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000016328a5e/0xbead52e175fc27b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc27ab expref: 12 pid: 6478 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869475.472212:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869475.472220:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed5334eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+12:3617:x1875765554580480:12345-0@lo:103: 00010000:00010000:3.0:1788869475.472232:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869475.472237:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000016328a5e/0xbead52e175fc27b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc27ab expref: 12 pid: 6478 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.472269:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000016328a5e/0xbead52e175fc27b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc27ab expref: 12 pid: 6478 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.472283:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000016328a5e/0xbead52e175fc27b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc27ab expref: 12 pid: 6478 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.472359:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003665a10c/0xbead52e175fc27e3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.472368:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003665a10c/0xbead52e175fc27e3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788869475.472390:0:6469:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002539960s 00010000:00010000:3.0:1788869475.472394:0:6469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003665a10c/0xbead52e175fc27e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.472402:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003665a10c/0xbead52e175fc27e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.472408:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003665a10c/0xbead52e175fc27e3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.472414:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003665a10c/0xbead52e175fc27e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.472419:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003665a10c already unused, calling callback (000000000b2a4490) 00010000:00010000:3.0:1788869475.472422:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003665a10c/0xbead52e175fc27e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.472428:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003665a10c/0xbead52e175fc27e3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.472461:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003665a10c/0xbead52e175fc27e3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869475.472472:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869475.472479:0:6500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003665a10c/0xbead52e175fc27e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869475.472497:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003665a10c/0xbead52e175fc27e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869475.472504:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003665a10c/0xbead52e175fc27e3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869475.472509:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed5334eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+11:3617:x1875765554580480:12345-0@lo:103: Request processed in 289us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869475.472520:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869475.472547:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000c314522 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554580480:0@lo:103: 00080000:10000000:2.0:1788869475.476765:0:6461:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1788869475.476979:0:6461:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788869475.477235:0:6461:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1788869475.477431:0:6461:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788869475.477612:0:6461:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1788869475.477788:0:6461:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1788869475.478622:0:6461:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1788869475.478789:0:6461:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788869475.478974:0:6461:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1788869475.479163:0:6461:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788869475.479404:0:6461:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1788869475.479580:0:6461:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1788869475.483180:0:6461:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788869475.492724:0:6461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788869475.492729:0:6516:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788869475.492736:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788869475.493001:0:6517:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788869475.496363:0:6461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788869475.496513:0:6461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788869475.497026:0:6461:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788869475.497035:0:6461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788869475.497851:0:6461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869475.499523:0:6461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788869475.499945:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869475.500465:0:6461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788869475.500508:0:6461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788869475.501204:0:6461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788869475.501615:0:6461:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1788869475.502492:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788869475.502602:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788869475.502698:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788869475.502801:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788869475.502911:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788869475.503021:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788869475.503176:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788869475.503315:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788869475.503489:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788869475.503576:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788869475.503668:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788869475.503757:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788869475.503887:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788869475.503999:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788869475.504157:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788869475.504338:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788869475.504567:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788869475.504667:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788869475.504754:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788869475.504893:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788869475.504984:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788869475.505137:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788869475.505221:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788869475.505551:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788869475.505693:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00000040:00080000:0.0:1788869475.505843:0:6517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00100000:10000000:2.0:1788869475.505875:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00000004:00080000:0.0:1788869475.505986:0:6517:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788869475.505992:0:6517:0:(lod_dev.c:546:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1788869475.506058:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788869475.506792:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788869475.506924:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788869475.507523:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788869475.507673:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788869475.507812:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788869475.508009:0:6461:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788869475.511604:0:6461:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788869475.511645:0:6461:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb76cc1c5f988 00100000:10000000:2.0:1788869475.511652:0:6461:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788869475.513552:0:6461:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788869475.513564:0:6461:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788869475.513578:0:6461:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1788869475.513591:0:6461:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788869475.514210:0:6461:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788869475.515502:0:6461:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788869476.248726:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869477.272510:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788869477.613756:0:6761:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:3.0:1788869478.092979:0:6814:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788869478.093175:0:6814:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788869478.298890:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869479.320451:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788869479.984429:0:6915:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869479.984592:0:6915:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788869480.344416:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869480.856503:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009c50f244 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554580608:0@lo:400: 00000100:00100000:2.0:1788869480.856604:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788869480.856715:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788869480.856721:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788869480.856725:0:37:0:(import.c:65:import_set_state_nolock()) 000000005b3fcdac lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869480.856736:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005b3fcdac using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788869480.856775:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d682acbb x1875765554580736/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869480.856811:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d682acbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875765554580736:0@lo:38: 00000100:00100000:3.0:1788869480.856857:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869480.856909:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554580736 00000100:00100000:0.0:1788869480.856921:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554580736 00000100:00100000:1.0:1788869480.857012:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554580608 00000100:00100000:1.0:1788869480.857017:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554580608 00000100:00100000:1.0:1788869480.857065:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788869480.857073:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005246833a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+11:3618:x1875765554580608:12345-0@lo:400: 00000100:00100000:0.0:1788869480.857144:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869480.857151:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1d69475 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1875765554580736:12345-0@lo:38: 00010000:00080000:0.0:1788869480.857224:0:6486:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 98 last 0 00000020:00000080:0.0:1788869480.857313:0:6486:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbead52e175fc27ea 00000004:00100000:0.0:1788869480.857373:0:6486:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788869480.857499:0:6486:0:(import.c:65:import_set_state_nolock()) 000000009edca813 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869480.857557:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1d69475 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875765554580736:12345-0@lo:38: Request processed in 405us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869480.857566:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788869480.857820:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d682acbb x1875765554580736/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788869480.857838:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788869480.857845:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788869480.857850:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788869480.857852:0:3615:0:(import.c:65:import_set_state_nolock()) 000000005b3fcdac lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788869480.857858:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d682acbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875765554580736:0@lo:38: 00000100:00100000:1.0:1788869480.859296:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005246833a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+11:3618:x1875765554580608:12345-0@lo:400: Request processed in 2214us (2684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869480.859308:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009c50f244 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554580608:0@lo:400: 00000100:00100000:1.0:1788869480.859313:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788869481.370747:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869482.393806:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788869482.905362:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788869482.905369:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ff8b15e800 from 3 10000000:01000000:0.0:1788869482.905373:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788869482.905412:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 00000000efe8350f/0xbead52e175fc27f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869482.905423:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 00000000efe8350f/0xbead52e175fc27f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869482.905434:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 00000000efe8350f/0xbead52e175fc27f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869482.906370:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ed8e3457 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554580864:0@lo:101: 00000100:00100000:0.0:1788869482.906438:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869482.906585:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e6df87ed going to sleep for 11 seconds 00000100:00100000:1.0:1788869482.906599:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554580864 00000100:00100000:1.0:1788869482.906608:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554580864 00000100:00100000:1.0:1788869482.906717:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788869482.906726:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e245aa34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+11:6481:x1875765554580864:12345-0@lo:101: 00010000:00010000:1.0:1788869482.906739:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869482.906753:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e3ad055c/0xbead52e175fc27f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc27f1 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869482.906777:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e3ad055c/0xbead52e175fc27f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc27f1 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869482.906793:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e3ad055c/0xbead52e175fc27f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc27f1 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869482.906802:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e3ad055c, rc 0) 00000100:00100000:1.0:1788869482.906849:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e245aa34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+12:6481:x1875765554580864:12345-0@lo:101: Request processed in 124us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869482.906856:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788869482.906964:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ed8e3457 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554580864:0@lo:101: 00010000:00010000:0.0:1788869482.906975:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 00000000efe8350f/0xbead52e175fc27f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc27f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869482.906982:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 00000000efe8350f/0xbead52e175fc27f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc27f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869482.907015:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ed8e3457 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554580992:0@lo:256: 00000100:00100000:0.0:1788869482.907044:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869482.907070:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e6df87ed going to sleep for 11 seconds 00000100:00100000:1.0:1788869482.907129:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554580992 00000100:00100000:1.0:1788869482.907134:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554580992 00000100:00100000:1.0:1788869482.907160:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788869482.907165:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d8fef48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+12:6481:x1875765554580992:12345-0@lo:256: 20000000:01000000:1.0:1788869482.907179:0:6478:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788869482.907193:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788869482.907197:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788869482.907575:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d8fef48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+12:6481:x1875765554580992:12345-0@lo:256: Request processed in 410us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869482.907583:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788869482.907611:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ed8e3457 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554580992:0@lo:256: 10000000:01000000:1.0:1788869482.907649:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788869482.907654:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 00000000efe8350f/0xbead52e175fc27f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc27f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869482.907662:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 00000000efe8350f/0xbead52e175fc27f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc27f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869483.416384:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869484.440570:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788869485.277821:0:7413:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788869485.277826:0:7413:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788869485.277827:0:7413:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788869485.277974:0:7413:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000c68db66e 00000020:01000004:0.0:1788869485.277993:0:7413:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1788869485.278004:0:7413:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788869485.278022:0:7413:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000dd80b01f) 00000020:00000080:0.0:1788869485.278042:0:7413:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788869485.331136:0:7413:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1788869485.331278:0:7413:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1788869485.351816:0:7413:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788869485.352097:0:7413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788869485.352111:0:7413:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788869485.352125:0:7413:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbead52e175fc2806 00000020:01000004:2.0:1788869485.352134:0:7413:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788869485.352162:0:7413:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.130@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788869485.352166:0:7413:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788869485.352173:0:7413:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788869485.352210:0:7413:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788869485.352215:0:7413:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788869485.366906:0:7413:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788869485.366961:0:7413:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.130@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1788869485.366966:0:7413:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788869485.366968:0:7413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788869485.366969:0:7413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869485.366971:0:7413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869485.366972:0:7413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869485.366973:0:7413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869485.366975:0:7413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788869485.366976:0:7413:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788869485.366978:0:7413:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788869485.366980:0:7413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869485.366981:0:7413:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788869485.366986:0:7413:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1788869485.366988:0:7413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788869485.366990:0:7413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788869485.366990:0:7413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869485.366991:0:7413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869485.366992:0:7413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869485.366993:0:7413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869485.366994:0:7413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788869485.366995:0:7413:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788869485.366996:0:7413:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788869485.366997:0:7413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869485.366998:0:7413:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788869485.367044:0:7413:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788869485.367073:0:7413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d682acbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554581120:0@lo:253: 00000100:00100000:3.0:1788869485.367244:0:7413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869485.367527:0:7413:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a1fadb2d going to sleep for 11 seconds 00000100:00100000:0.0:1788869485.367928:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554581120 00000100:00100000:0.0:1788869485.367940:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554581120 00000100:00100000:0.0:1788869485.368057:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788869485.368066:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f796bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+12:7413:x1875765554581120:12345-0@lo:253: 20000000:01000000:0.0:1788869485.368107:0:6476:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788869485.368113:0:6476:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1788869485.368118:0:6476:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1788869485.368122:0:6476:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1788869485.368163:0:6476:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1788869485.368440:0:6476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869485.368566:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788869485.368590:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788869485.368606:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1788869485.368619:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1788869485.368632:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1788869485.368685:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1788869485.368693:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1788869485.368704:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1788869485.368709:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1788869485.368720:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1788869485.368724:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1788869485.368735:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788869485.368747:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788869485.368861:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1788869485.368885:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.130@tcp (null) (null) (null) 00000040:00080000:0.0:1788869485.368900:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1788869485.368906:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788869485.368917:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1788869485.368923:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.201.130@tcp (null) (null) 00000040:00080000:0.0:1788869485.368934:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1788869485.368939:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788869485.368950:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788869485.368964:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788869485.368973:0:6476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788869485.369053:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1788869485.369063:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1788869485.369075:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788869485.369089:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788869485.369104:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1788869485.369109:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1788869485.369120:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788869485.369149:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788869485.369155:0:6476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1788869485.369178:0:6476:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788869485.369185:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1788869485.373110:0:7419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788869485.373622:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788869485.373652:0:6476:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.130@tcp for mdt 20000000:01000000:3.0:1788869485.373654:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.130@tcp (null) (null) (null) 00000040:00080000:3.0:1788869485.373665:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788869485.373671:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788869485.373684:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788869485.373690:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.201.130@tcp (null) (null) 00000040:00080000:3.0:1788869485.373706:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788869485.373716:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1788869485.373729:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1788869485.373738:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1788869485.373796:0:6476:0:(mgs_llog.c:3431:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1788869485.373806:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1788869485.374394:0:7420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1788869485.374506:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788869485.374518:0:6476:0:(mgs_llog.c:3489:mgs_write_log_osp_to_mdt()) add nid 192.168.201.130@tcp for mdt 20000000:01000000:3.0:1788869485.374519:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.130@tcp (null) (null) (null) 00000040:00080000:3.0:1788869485.374526:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788869485.374530:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788869485.374536:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788869485.374539:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.201.130@tcp (null) (null) 00000040:00080000:3.0:1788869485.374545:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788869485.374548:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1788869485.374555:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788869485.374562:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1788869485.374576:0:6476:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788869485.374578:0:6476:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788869485.374581:0:6476:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788869485.374632:0:6476:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788869485.374633:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788869485.374847:0:7421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788869485.374875:0:7421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788869485.374893:0:7421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788869485.375035:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788869485.375055:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788869485.375076:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788869485.375087:0:6476:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788869485.375088:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788869485.375458:0:7422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788869485.375480:0:7422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788869485.375495:0:7422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1788869485.375644:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788869485.375664:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788869485.375679:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1788869485.375687:0:6476:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788869485.375688:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788869485.376047:0:7423:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788869485.376065:0:7423:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788869485.376080:0:7423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788869485.376384:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1788869485.376402:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1788869485.376417:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1788869485.376429:0:6476:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788869485.376431:0:6476:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788869485.376437:0:6476:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788869485.376444:0:6476:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788869485.376717:0:7424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1788869485.376821:0:6476:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788869485.385452:0:6476:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788869485.385529:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000215c4be7/0xbead52e175fc280d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.385554:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000705a0d9f/0xbead52e175fc2742 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc273b expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.385562:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cc3e9845/0xbead52e175fc275e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2757 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.385570:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000095cc9e2a/0xbead52e175fc27ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc27c7 expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.385597:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000215c4be7/0xbead52e175fc280d lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.385653:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000095cc9e2a/0xbead52e175fc27ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc27c7 expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.385684:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000095cc9e2a/0xbead52e175fc27ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc27c7 expref: 12 pid: 6476 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869485.385703:0:6476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004773874e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875765554581248:0@lo:104: 00000100:00100000:3.0:1788869485.385803:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869485.385943:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cc3e9845/0xbead52e175fc275e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2757 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.385951:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cc3e9845/0xbead52e175fc275e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2757 expref: 12 pid: 6478 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869485.385959:0:6476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003084d8ea pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875765554581376:0@lo:104: 00000100:00100000:3.0:1788869485.385981:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869485.386005:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000705a0d9f/0xbead52e175fc2742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc273b expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.386012:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000705a0d9f/0xbead52e175fc2742 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc273b expref: 12 pid: 6478 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869485.386019:0:6476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000046c0dbad pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875765554581504:0@lo:104: 00000100:00100000:1.0:1788869485.386024:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554581248 00000100:00100000:3.0:1788869485.386039:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869485.386043:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554581248 00000100:00100000:3.0:1788869485.386048:0:6476:0:(client.c:2702:ptlrpc_set_wait()) set 0000000066ed1876 going to sleep for 11 seconds 00000100:00100000:1.0:1788869485.386091:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554581376 00000100:00100000:1.0:1788869485.386094:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554581376 00000100:00100000:1.0:1788869485.386105:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554581504 00000100:00100000:1.0:1788869485.386107:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554581504 00000100:00100000:1.0:1788869485.386120:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869485.386129:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001964b904 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+5:6476:x1875765554581248:12345-0@lo:104: 00010000:00010000:1.0:1788869485.386146:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: 0000000008e31d89/0xbead52e175fc27c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc27ce expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.386222:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788869485.386228:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001964b904 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+5:6476:x1875765554581248:12345-0@lo:104: Request processed in 100us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869485.386237:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869485.386277:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869485.386282:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050ca141f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+4:6476:x1875765554581376:12345-0@lo:104: 00000100:00100000:3.0:1788869485.386286:0:6476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004773874e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875765554581248:0@lo:104: 00010000:00010000:1.0:1788869485.386289:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: 00000000e8e667c7/0xbead52e175fc2757 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc275e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.386326:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788869485.386329:0:6476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003084d8ea pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875765554581376:0@lo:104: 00000100:00100000:1.0:1788869485.386331:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050ca141f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+4:6476:x1875765554581376:12345-0@lo:104: Request processed in 50us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869485.386336:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869485.386347:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869485.386352:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2c0f71e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+3:6476:x1875765554581504:12345-0@lo:104: 00010000:00010000:1.0:1788869485.386359:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc273b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2742 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.386377:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869485.386383:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: 0000000008e31d89/0xbead52e175fc27c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc27ce expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.386390:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000008e31d89 already unused, calling callback (00000000cb5a5c96) 10000000:00010000:0.0:1788869485.386393:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: 0000000008e31d89/0xbead52e175fc27c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc27ce expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.386402:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: 0000000008e31d89/0xbead52e175fc27c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc27ce expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.386406:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788869485.386410:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2c0f71e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+3:6476:x1875765554581504:12345-0@lo:104: Request processed in 59us (371us total) trans 0 rc 0/0 10000000:00010000:0.0:1788869485.386410:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: 0000000008e31d89/0xbead52e175fc27c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc27ce expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869485.386416:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788869485.386417:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788869485.386430:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869485.386455:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: 0000000008e31d89/0xbead52e175fc27c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc27ce expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.386463:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869485.386484:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: 0000000008e31d89/0xbead52e175fc27c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc27ce expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.386490:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: 0000000008e31d89/0xbead52e175fc27c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc27ce expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.386505:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869485.386507:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc273b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2742 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.386512:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004f67f551 already unused, calling callback (00000000cb5a5c96) 10000000:00010000:0.0:1788869485.386514:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc273b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2742 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.386520:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc273b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2742 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869485.386524:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc273b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2742 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869485.386529:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869485.386542:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc273b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2742 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.386548:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869485.386562:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc273b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2742 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.386578:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc273b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2742 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.386587:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869485.386589:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869485.386590:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869485.386607:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869485.386611:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: 00000000e8e667c7/0xbead52e175fc2757 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc275e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.386618:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e8e667c7 already unused, calling callback (00000000cb5a5c96) 10000000:00010000:1.0:1788869485.386620:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: 00000000e8e667c7/0xbead52e175fc2757 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc275e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.386625:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: 00000000e8e667c7/0xbead52e175fc2757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc275e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869485.386630:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: 00000000e8e667c7/0xbead52e175fc2757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc275e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869485.386635:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788869485.386649:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: 00000000e8e667c7/0xbead52e175fc2757 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc275e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.386654:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869485.386657:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: 00000000e8e667c7/0xbead52e175fc2757 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc275e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.386662:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: 00000000e8e667c7/0xbead52e175fc2757 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc275e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.386685:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869485.386686:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869485.386688:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869485.386696:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869485.386697:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869485.386726:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004205a81a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554581760:0@lo:103: 00000100:00100000:1.0:1788869485.386756:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869485.386824:0:6476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000046c0dbad pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875765554581504:0@lo:104: 00010000:00010000:3.0:1788869485.386856:0:6476:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000215c4be7/0xbead52e175fc280d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869485.386995:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bc00a0e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554581888:0@lo:103: 00000100:00100000:0.0:1788869485.387025:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869485.387092:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554581760 00000100:00100000:3.0:1788869485.387097:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554581760 00010000:00010000:3.0:1788869485.387115:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000705a0d9f/0xbead52e175fc2742 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc273b expref: 13 pid: 6478 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869485.387133:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554581888 00000100:00100000:3.0:1788869485.387136:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554581888 00010000:00010000:3.0:1788869485.387144:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cc3e9845/0xbead52e175fc275e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2757 expref: 14 pid: 6478 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869485.387166:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869485.387171:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a8a13ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+14:3616:x1875765554581760:12345-0@lo:103: 00010000:00010000:3.0:1788869485.387184:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869485.387188:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000705a0d9f/0xbead52e175fc2742 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc273b expref: 14 pid: 6478 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.387197:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000705a0d9f/0xbead52e175fc2742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc273b expref: 14 pid: 6478 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.387213:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000705a0d9f/0xbead52e175fc2742 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc273b expref: 14 pid: 6478 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.387228:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869485.387271:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a8a13ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+13:3616:x1875765554581760:12345-0@lo:103: Request processed in 81us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869485.387287:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869485.387301:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869485.387306:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eae045ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+12:3617:x1875765554581888:12345-0@lo:103: 00010000:00010000:3.0:1788869485.387314:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869485.387317:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cc3e9845/0xbead52e175fc275e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2757 expref: 12 pid: 6478 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.387323:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cc3e9845/0xbead52e175fc275e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2757 expref: 12 pid: 6478 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.387332:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cc3e9845/0xbead52e175fc275e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2757 expref: 12 pid: 6478 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.387340:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869485.387361:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eae045ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+11:3617:x1875765554581888:12345-0@lo:103: Request processed in 56us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869485.387367:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869485.387817:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869485.387830:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004da65600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554581632:0@lo:103: 00000100:00100000:2.0:1788869485.387876:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869485.387931:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554581632 00000100:00100000:3.0:1788869485.387935:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554581632 00010000:00010000:3.0:1788869485.387950:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000095cc9e2a/0xbead52e175fc27ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc27c7 expref: 11 pid: 6476 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869485.387965:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869485.387971:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034c0e10d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+11:3618:x1875765554581632:12345-0@lo:103: 00010000:00010000:3.0:1788869485.387978:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869485.387982:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000095cc9e2a/0xbead52e175fc27ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc27c7 expref: 11 pid: 6476 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.387991:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000095cc9e2a/0xbead52e175fc27ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc27c7 expref: 11 pid: 6476 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.388009:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000095cc9e2a/0xbead52e175fc27ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc27c7 expref: 11 pid: 6476 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.388024:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000215c4be7/0xbead52e175fc280d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.388032:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000215c4be7/0xbead52e175fc280d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.388046:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000215c4be7/0xbead52e175fc280d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.388053:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000215c4be7/0xbead52e175fc280d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.388060:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000215c4be7/0xbead52e175fc280d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.388066:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000215c4be7/0xbead52e175fc280d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.388072:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000215c4be7 already unused, calling callback (000000000b2a4490) 00010000:00010000:3.0:1788869485.388076:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000215c4be7/0xbead52e175fc280d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.388084:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000215c4be7/0xbead52e175fc280d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.388099:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000215c4be7/0xbead52e175fc280d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.388121:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869485.388145:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034c0e10d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+10:3618:x1875765554581632:12345-0@lo:103: Request processed in 175us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869485.388163:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788869485.388183:0:6476:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000215c4be7/0xbead52e175fc280d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.388191:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000215c4be7/0xbead52e175fc280d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.388196:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000215c4be7/0xbead52e175fc280d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788869485.388216:0:6476:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788869485.388916:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004205a81a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554581760:0@lo:103: 00000100:00100000:0.0:1788869485.389623:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bc00a0e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554581888:0@lo:103: 00000100:00100000:0.0:1788869485.390135:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f796bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+9:7413:x1875765554581120:12345-0@lo:253: Request processed in 22068us (22889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869485.390148:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788869485.390244:0:7413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d682acbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554581120:0@lo:253: 10000000:01000000:3.0:1788869485.390281:0:7413:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788869485.390285:0:7413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788869485.390288:0:7413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788869485.390289:0:7413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869485.390291:0:7413:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1788869485.390292:0:7413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869485.390293:0:7413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869485.390295:0:7413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788869485.390297:0:7413:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788869485.390300:0:7413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869485.390301:0:7413:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788869485.390319:0:7413:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c68db66e from lustre-MDT0001 10000000:01000000:3.0:1788869485.390356:0:7413:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788869485.390359:0:7413:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788869485.390367:0:7413:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99ff8b770000 local copy 10000000:01000000:3.0:1788869485.390371:0:7413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788869485.390425:0:7413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 00000000825d742f/0xbead52e175fc2814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.390437:0:7413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.130@tcp lock: 00000000825d742f/0xbead52e175fc2814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.390447:0:7413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 00000000825d742f/0xbead52e175fc2814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869485.390467:0:7413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d682acbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554582016:0@lo:101: 00000100:00100000:3.0:1788869485.390509:0:7413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869485.390548:0:7413:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bbc272e6 going to sleep for 11 seconds 00000100:00100000:0.0:1788869485.390801:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554582016 00000100:00100000:0.0:1788869485.390808:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554582016 00000100:00100000:0.0:1788869485.390853:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788869485.390909:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d56f15c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+9:7413:x1875765554582016:12345-0@lo:101: 00010000:00010000:0.0:1788869485.390925:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869485.390941:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005d7ad86d/0xbead52e175fc281b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2814 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.390967:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005d7ad86d/0xbead52e175fc281b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2814 expref: 10 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.390978:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005d7ad86d/0xbead52e175fc281b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2814 expref: 10 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.390987:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005d7ad86d, rc 0) 00000100:00100000:0.0:1788869485.391032:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d56f15c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+10:7413:x1875765554582016:12345-0@lo:101: Request processed in 173us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869485.391101:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004da65600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554581632:0@lo:103: 00000100:00100000:3.0:1788869485.391186:0:7413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d682acbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554582016:0@lo:101: 00010000:00010000:3.0:1788869485.391199:0:7413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 00000000825d742f/0xbead52e175fc2814 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbead52e175fc281b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.391209:0:7413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 00000000825d742f/0xbead52e175fc2814 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbead52e175fc281b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869485.391324:0:7413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d682acbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554582144:0@lo:501: 00000100:00100000:3.0:1788869485.391348:0:7413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869485.391371:0:7413:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bbc272e6 going to sleep for 11 seconds 00000100:00100000:2.0:1788869485.391470:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554582144 00000100:00100000:2.0:1788869485.391474:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554582144 00000100:00100000:0.0:1788869485.392375:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788869485.392445:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788869485.392456:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cae9ffb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+10:7413:x1875765554582144:12345-0@lo:501: 00000100:00100000:2.0:1788869485.392594:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cae9ffb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+10:7413:x1875765554582144:12345-0@lo:501: Request processed in 141us (1245us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788869485.392601:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788869485.392657:0:7413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d682acbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554582144:0@lo:501: 10000000:01000000:3.0:1788869485.392732:0:7413:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788869485.392756:0:7413:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788869485.392763:0:7413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 00000000825d742f/0xbead52e175fc2814 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbead52e175fc281b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.392774:0:7413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 00000000825d742f/0xbead52e175fc2814 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbead52e175fc281b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.392792:0:7413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: 00000000825d742f/0xbead52e175fc2814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbead52e175fc281b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.392845:0:7413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788869485.392882:0:7413:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ff89980800 10000000:01000000:3.0:1788869485.392888:0:7413:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788869485.392894:0:7413:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99ff8b770000 10000000:01000000:3.0:1788869485.392897:0:7413:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788869485.392900:0:7413:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff99ff8b770000 from 1 10000000:01000000:3.0:1788869485.392902:0:7413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788869485.392930:0:7413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 0000000063278d71/0xbead52e175fc2822 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.392939:0:7413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 0000000063278d71/0xbead52e175fc2822 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.392948:0:7413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 0000000063278d71/0xbead52e175fc2822 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869485.392965:0:7413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d682acbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554582272:0@lo:101: 00000100:00100000:3.0:1788869485.392997:0:7413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869485.393034:0:7413:0:(client.c:2702:ptlrpc_set_wait()) set 0000000066ed1876 going to sleep for 11 seconds 00010000:00010000:0.0:1788869485.393063:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869485.393070:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: 00000000825d742f/0xbead52e175fc2814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xbead52e175fc281b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.393078:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000825d742f already unused, calling callback (00000000cb5a5c96) 10000000:00010000:0.0:1788869485.393081:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: 00000000825d742f/0xbead52e175fc2814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xbead52e175fc281b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.393090:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: 00000000825d742f/0xbead52e175fc2814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xbead52e175fc281b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869485.393096:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: 00000000825d742f/0xbead52e175fc2814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xbead52e175fc281b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869485.393102:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869485.393122:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: 00000000825d742f/0xbead52e175fc2814 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbead52e175fc281b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.393129:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788869485.393142:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554582272 00000100:00100000:1.0:1788869485.393148:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554582272 00000100:00100000:1.0:1788869485.393187:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788869485.393193:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a8256ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+10:7413:x1875765554582272:12345-0@lo:101: 00010000:00010000:1.0:1788869485.393202:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869485.393216:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e498504e/0xbead52e175fc2829 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2822 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.393236:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e498504e/0xbead52e175fc2829 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2822 expref: 11 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869485.393239:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086d3b5ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554582400:0@lo:103: 00010000:00010000:1.0:1788869485.393247:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e498504e/0xbead52e175fc2829 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2822 expref: 11 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.393276:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e498504e, rc 0) 00000100:00100000:2.0:1788869485.393299:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869485.393306:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a8256ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+11:7413:x1875765554582272:12345-0@lo:101: Request processed in 114us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869485.393313:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788869485.393381:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: 00000000825d742f/0xbead52e175fc2814 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbead52e175fc281b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.393389:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: 00000000825d742f/0xbead52e175fc2814 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbead52e175fc281b expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.393406:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869485.393408:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869485.393409:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869485.393418:0:7413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d682acbb pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554582272:0@lo:101: 00010000:00010000:1.0:1788869485.393432:0:7413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 0000000063278d71/0xbead52e175fc2822 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2829 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.393439:0:7413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 0000000063278d71/0xbead52e175fc2822 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2829 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869485.393459:0:7413:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788869485.393475:0:7413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 0000000063278d71/0xbead52e175fc2822 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2829 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.393481:0:7413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 0000000063278d71/0xbead52e175fc2822 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2829 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869485.393489:0:7413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99ff89980800 10000000:01000000:1.0:1788869485.393492:0:7413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788869485.393495:0:7413:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99ff89980800 from 1 10000000:01000000:1.0:1788869485.393497:0:7413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788869485.393511:0:7413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 00000000b885c084/0xbead52e175fc2830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.393517:0:7413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 00000000b885c084/0xbead52e175fc2830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.393522:0:7413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 00000000b885c084/0xbead52e175fc2830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869485.393525:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554582400 00000100:00100000:2.0:1788869485.393528:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554582400 00000100:00100000:1.0:1788869485.393533:0:7413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009b6dec45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554582528:0@lo:101: 00000100:00100000:1.0:1788869485.393554:0:7413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869485.393572:0:7413:0:(client.c:2702:ptlrpc_set_wait()) set 0000000034874f3f going to sleep for 11 seconds 00000100:00100000:0.0:1788869485.393596:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554582528 00000100:00100000:0.0:1788869485.393599:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554582528 00000100:00100000:0.0:1788869485.393630:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788869485.393636:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e4a0533 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+12:7413:x1875765554582528:12345-0@lo:101: 00010000:00010000:0.0:1788869485.393642:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869485.393651:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000082559b28/0xbead52e175fc2837 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2830 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.393663:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000082559b28/0xbead52e175fc2837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2830 expref: 13 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.393681:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000082559b28/0xbead52e175fc2837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2830 expref: 13 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.393688:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000082559b28, rc 0) 00000100:00100000:0.0:1788869485.393725:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e4a0533 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+13:7413:x1875765554582528:12345-0@lo:101: Request processed in 90us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869485.393731:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788869485.393821:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869485.393829:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048d2651d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+12:3618:x1875765554582400:12345-0@lo:103: 00010000:00010000:2.0:1788869485.393838:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788869485.393841:0:7413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009b6dec45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554582528:0@lo:101: 00010000:00010000:2.0:1788869485.393851:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005d7ad86d/0xbead52e175fc281b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbead52e175fc2814 expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.393854:0:7413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 00000000b885c084/0xbead52e175fc2830 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2837 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.393860:0:7413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 00000000b885c084/0xbead52e175fc2830 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2837 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869485.393880:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:1.0:1788869485.393881:0:7413:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788869485.393894:0:7413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 00000000b885c084/0xbead52e175fc2830 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2837 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.393901:0:7413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 00000000b885c084/0xbead52e175fc2830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2837 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869485.393907:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048d2651d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+11:3618:x1875765554582400:12345-0@lo:103: Request processed in 81us (609us total) trans 0 rc 0/0 10000000:01000000:1.0:1788869485.393907:0:7413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788869485.393910:0:7413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 00000100:00100000:2.0:1788869485.393913:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 10000000:01000000:1.0:1788869485.393914:0:7413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99ff89980800 10000000:01000000:1.0:1788869485.393917:0:7413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788869485.393919:0:7413:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788869485.393921:0:7413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788869485.393934:0:7413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 00000000236f6304/0xbead52e175fc283e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.393940:0:7413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 00000000236f6304/0xbead52e175fc283e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.393947:0:7413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 00000000236f6304/0xbead52e175fc283e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869485.393958:0:7413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009b6dec45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554582656:0@lo:101: 00000100:00100000:1.0:1788869485.393982:0:7413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869485.394008:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086d3b5ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554582400:0@lo:103: 00000100:00100000:1.0:1788869485.394018:0:7413:0:(client.c:2702:ptlrpc_set_wait()) set 0000000034874f3f going to sleep for 11 seconds 00000100:00100000:0.0:1788869485.394044:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554582656 00000100:00100000:0.0:1788869485.394047:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554582656 00000100:00100000:0.0:1788869485.394075:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788869485.394081:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a719848 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+11:7413:x1875765554582656:12345-0@lo:101: 00010000:00010000:0.0:1788869485.394087:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869485.394095:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b50c0f63/0xbead52e175fc2845 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc283e expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.394107:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b50c0f63/0xbead52e175fc2845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc283e expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.394114:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b50c0f63/0xbead52e175fc2845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc283e expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.394126:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b50c0f63, rc 0) 00000100:00100000:1.0:1788869485.394176:0:7413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009b6dec45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554582656:0@lo:101: 00010000:00010000:1.0:1788869485.394184:0:7413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 00000000236f6304/0xbead52e175fc283e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2845 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.394192:0:7413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 00000000236f6304/0xbead52e175fc283e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2845 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869485.394243:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a719848 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+12:7413:x1875765554582656:12345-0@lo:101: Request processed in 72us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869485.394249:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788869485.394320:0:7413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009b6dec45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554582784:0@lo:501: 00000100:00100000:1.0:1788869485.394346:0:7413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869485.394369:0:7413:0:(client.c:2702:ptlrpc_set_wait()) set 0000000034874f3f going to sleep for 11 seconds 00000100:00100000:0.0:1788869485.394373:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554582784 00000100:00100000:0.0:1788869485.394376:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554582784 00000100:00100000:0.0:1788869485.394427:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788869485.394433:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdf92d25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+12:7413:x1875765554582784:12345-0@lo:501: 00000100:00100000:0.0:1788869485.394538:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdf92d25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+12:7413:x1875765554582784:12345-0@lo:501: Request processed in 105us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869485.394545:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788869485.394595:0:7413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009b6dec45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554582784:0@lo:501: 00000100:00100000:1.0:1788869485.394635:0:7413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009b6dec45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554582912:0@lo:503: 00000100:00100000:1.0:1788869485.394670:0:7413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869485.394688:0:7413:0:(client.c:2702:ptlrpc_set_wait()) set 0000000034874f3f going to sleep for 11 seconds 00000100:00100000:0.0:1788869485.394738:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554582912 00000100:00100000:0.0:1788869485.394743:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554582912 00000100:00100000:0.0:1788869485.394797:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788869485.394804:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a9555e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+12:7413:x1875765554582912:12345-0@lo:503: 00000100:00100000:0.0:1788869485.394899:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a9555e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+12:7413:x1875765554582912:12345-0@lo:503: Request processed in 96us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869485.394906:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788869485.394960:0:7413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009b6dec45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554582912:0@lo:503: 00000040:00080000:1.0:1788869485.395506:0:7413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788869485.395580:0:7413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009b6dec45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554583040:0@lo:502: 00000100:00100000:1.0:1788869485.395610:0:7413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869485.395635:0:7413:0:(client.c:2702:ptlrpc_set_wait()) set 0000000034874f3f going to sleep for 11 seconds 00000100:00100000:0.0:1788869485.395640:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554583040 00000100:00100000:0.0:1788869485.395645:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554583040 00000100:00100000:0.0:1788869485.395754:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788869485.395761:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096c427f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+12:7413:x1875765554583040:12345-0@lo:502: 00000100:00100000:0.0:1788869485.395845:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096c427f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+12:7413:x1875765554583040:12345-0@lo:502: Request processed in 85us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869485.395853:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788869485.395862:0:7413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009b6dec45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554583040:0@lo:502: 00000040:00080000:1.0:1788869485.396187:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788869485.396214:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1788869485.396226:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1788869485.396233:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1788869485.396240:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1788869485.396246:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1788869485.396296:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1788869485.396307:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1788869485.396317:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1788869485.396331:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1788869485.396342:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1788869485.396354:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1788869485.396365:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1788869485.396378:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1788869485.396391:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1788869485.396404:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1788869485.396416:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1788869485.396429:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1788869485.396441:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1788869485.396448:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1788869485.396455:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1788869485.396463:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1788869485.396479:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1788869485.396495:0:7413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009b6dec45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554583168:0@lo:502: 00000100:00100000:1.0:1788869485.396521:0:7413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869485.396546:0:7413:0:(client.c:2702:ptlrpc_set_wait()) set 0000000034874f3f going to sleep for 11 seconds 00000100:00100000:0.0:1788869485.396552:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554583168 00000100:00100000:0.0:1788869485.396562:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554583168 00000100:00100000:0.0:1788869485.396626:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788869485.396632:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9da8448 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+12:7413:x1875765554583168:12345-0@lo:502: 00000100:00100000:0.0:1788869485.396716:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9da8448 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+12:7413:x1875765554583168:12345-0@lo:502: Request processed in 85us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869485.396723:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788869485.397123:0:7413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009b6dec45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554583168:0@lo:502: 00000040:00080000:1.0:1788869485.397164:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1788869485.397174:0:7413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1788869485.400023:0:7426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869485.400043:0:7426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869485.400046:0:7426:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788869485.400058:0:7426:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788869485.400061:0:7426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788869485.400081:0:7426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000030af9b91) 00000020:00000080:3.0:1788869485.400109:0:7426:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1788869485.400126:0:7426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788869485.400327:0:7426:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788869485.400336:0:7426:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbead52e175fc2853 00000020:00000080:3.0:1788869485.400611:0:7426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788869485.400617:0:7426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869485.400620:0:7426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869485.400622:0:7426:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788869485.400625:0:7426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869485.400628:0:7426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869485.400630:0:7426:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788869485.400633:0:7426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788869485.400641:0:7426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000034020d9b) 00000020:00000080:3.0:1788869485.400652:0:7426:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1788869485.400656:0:7426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788869485.400658:0:7426:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788869485.400661:0:7426:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788869485.400740:0:7426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788869485.400799:0:7426:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c68db66e from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788869485.400820:0:7426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000d6657128) 00000020:00000080:3.0:1788869485.400830:0:7426:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1788869485.400927:0:7426:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788869485.400933:0:7426:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbead52e175fc2868 00000020:00000080:3.0:1788869485.401038:0:7426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788869485.401046:0:7426:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788869485.401051:0:7426:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xbead52e175fc286f 00080000:01000000:3.0:1788869485.401057:0:7426:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788869485.401060:0:7426:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbead52e175fc2876 00080000:10000000:3.0:1788869485.401948:0:7426:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788869485.402092:0:7426:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1788869485.464732:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869485.477980:0:7426:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1788869485.478590:0:7426:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1788869485.480968:0:7426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788869485.481435:0:7426:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788869485.494317:0:7426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788869485.494335:0:7426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869485.494342:0:7426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869485.494344:0:7426:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788869485.494346:0:7426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869485.494351:0:7426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869485.494352:0:7426:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788869485.494354:0:7426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788869485.494359:0:7426:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:00000080:3.0:1788869485.495492:0:7426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788869485.495513:0:7426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000ce3b5f88) 00000020:00000080:3.0:1788869485.495542:0:7426:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788869485.495548:0:7426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788869485.495645:0:7426:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788869485.495652:0:7426:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788869485.495659:0:7426:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbead52e175fc2884 00010000:00080000:3.0:1788869485.495698:0:7426:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e4525822@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.130@tcp at head 00010000:00010000:3.0:1788869485.500503:0:7426:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1788869485.502604:0:7426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788869485.502622:0:7426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788869485.502659:0:7426:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788869485.502685:0:7426:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbead52e175fc288b 00000100:00080000:3.0:1788869485.502699:0:7426:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788869485.502705:0:7426:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000e4525822 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788869485.502749:0:7426:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000046c0dbad x1875765554583296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869485.502814:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000046c0dbad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554583296:0@lo:38: 00000100:00100000:1.0:1788869485.502923:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788869485.502999:0:7426:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1788869485.503056:0:7426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869485.503061:0:7426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869485.503063:0:7426:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788869485.503076:0:7426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788869485.503079:0:7426:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788869485.503081:0:7426:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788869485.503082:0:7426:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788869485.503083:0:7426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788869485.503086:0:7426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869485.503087:0:7426:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788869485.503089:0:7426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869485.503094:0:7426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869485.503096:0:7426:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788869485.503100:0:7426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788869485.503137:0:7426:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788869485.503149:0:7426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869485.503153:0:7426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869485.503154:0:7426:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788869485.503157:0:7426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869485.503159:0:7426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869485.503160:0:7426:0:(obd_config.c:1561:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788869485.503163:0:7426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788869485.503164:0:7426:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788869485.503202:0:7426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869485.503206:0:7426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869485.503207:0:7426:0:(obd_config.c:1561:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788869485.503210:0:7426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:3.0:1788869485.503426:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003084d8ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554583424:0@lo:400: 00000020:01000000:0.0:1788869485.503454:0:7413:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 00000100:00100000:3.0:1788869485.503460:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788869485.503493:0:7413:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788869485.503508:0:7413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 00000000236f6304/0xbead52e175fc283e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2845 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869485.503516:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554583424 00010000:00010000:0.0:1788869485.503519:0:7413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 00000000236f6304/0xbead52e175fc283e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2845 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869485.503524:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554583424 10000000:01000000:0.0:1788869485.503538:0:7413:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ff89980800 from 1 10000000:01000000:0.0:1788869485.503541:0:7413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00100000:3.0:1788869485.503567:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788869485.503568:0:7413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc2892 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869485.503575:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004773874e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554583424:12345-0@lo:400: 00010000:00010000:0.0:1788869485.503575:0:7413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc2892 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.503587:0:7413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc2892 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869485.503599:0:7413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f81b8c7e pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554583552:0@lo:101: 00000100:00100000:3.0:1788869485.503629:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004773874e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554583424:12345-0@lo:400: Request processed in 55us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869485.503630:0:7413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869485.503645:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869485.503655:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554583552 00000100:00100000:0.0:1788869485.503659:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554583552 00010000:00080000:3.0:1788869485.503683:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003084d8ea x1875765554583424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869485.503686:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788869485.503697:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003084d8ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554583424:0@lo:400: 00000100:00100000:0.0:1788869485.503697:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a58bd36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+12:7413:x1875765554583552:12345-0@lo:101: 00010000:00010000:0.0:1788869485.503707:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869485.503719:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003e486a08/0xbead52e175fc2899 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2892 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869485.503741:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554583296 00010000:00010000:0.0:1788869485.503742:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e486a08/0xbead52e175fc2899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2892 expref: 13 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869485.503744:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554583296 00010000:00010000:0.0:1788869485.503752:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003e486a08/0xbead52e175fc2899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2892 expref: 13 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869485.503760:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788869485.503761:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003e486a08, rc 0) 00000100:00100000:3.0:1788869485.503764:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b6dec45 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3615:x1875765554583296:12345-0@lo:38: 00010000:00080000:3.0:1788869485.503781:0:6489:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 103 last 0 00000100:00100000:0.0:1788869485.503781:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a58bd36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+13:7413:x1875765554583552:12345-0@lo:101: Request processed in 86us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869485.503787:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000020:00000080:3.0:1788869485.503810:0:6489:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbead52e175fc28a0 00000100:00100000:0.0:1788869485.503817:0:7413:0:(client.c:2702:ptlrpc_set_wait()) set 0000000074720053 going to sleep for 11 seconds 00000004:00100000:3.0:1788869485.503827:0:6489:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1788869485.503828:0:7413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f81b8c7e pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554583552:0@lo:101: 00000001:00000004:3.0:1788869485.503833:0:6489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1788869485.503840:0:7413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc2892 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2899 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.503847:0:7413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc2892 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2899 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869485.504799:0:7413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f81b8c7e pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554583680:0@lo:256: 00000100:00100000:0.0:1788869485.504849:0:7413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869485.504897:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554583680 00000100:00100000:0.0:1788869485.504903:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554583680 00000100:00100000:0.0:1788869485.504928:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788869485.504934:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a4e398f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+13:7413:x1875765554583680:12345-0@lo:256: 00000100:00100000:3.0:1788869485.505806:0:7413:0:(client.c:2702:ptlrpc_set_wait()) set 0000000074720053 going to sleep for 11 seconds 20000000:01000000:0.0:1788869485.506922:0:6476:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788869485.506943:0:6476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788869485.506946:0:6476:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788869485.507288:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a4e398f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+13:7413:x1875765554583680:12345-0@lo:256: Request processed in 2351us (2435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869485.507299:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788869485.507353:0:7413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f81b8c7e pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554583680:0@lo:256: 10000000:01000000:2.0:1788869485.507927:0:7413:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788869485.507956:0:7413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc2892 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2899 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869485.507968:0:7413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc2892 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2899 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869485.507976:0:7413:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ff89980800 from 1 10000000:01000000:2.0:1788869485.507979:0:7413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788869485.508020:0:7413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 00000000e336a97e/0xbead52e175fc28a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869485.508027:0:7413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 00000000e336a97e/0xbead52e175fc28a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869485.508043:0:7413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 00000000e336a97e/0xbead52e175fc28a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869485.508062:0:7413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ca496de7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554583808:0@lo:101: 00000100:00100000:2.0:1788869485.508104:0:7413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869485.508142:0:7413:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c0a2f74f going to sleep for 11 seconds 00000100:00100000:0.0:1788869485.508290:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554583808 00000100:00100000:0.0:1788869485.508299:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554583808 00000100:00100000:0.0:1788869485.508348:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788869485.508358:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001aec4807 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+13:7413:x1875765554583808:12345-0@lo:101: 00010000:00010000:0.0:1788869485.508481:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869485.508498:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000016328a5e/0xbead52e175fc28ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc28a7 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.508526:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000016328a5e/0xbead52e175fc28ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc28a7 expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.508538:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000016328a5e/0xbead52e175fc28ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc28a7 expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.508547:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000016328a5e, rc 0) 00000100:00100000:0.0:1788869485.508639:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001aec4807 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+14:7413:x1875765554583808:12345-0@lo:101: Request processed in 283us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869485.508647:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788869485.508727:0:7413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ca496de7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554583808:0@lo:101: 00010000:00010000:2.0:1788869485.508742:0:7413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 00000000e336a97e/0xbead52e175fc28a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc28ae expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869485.508751:0:7413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 00000000e336a97e/0xbead52e175fc28a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc28ae expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869485.508892:0:7413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ca496de7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554583936:0@lo:501: 00000100:00100000:2.0:1788869485.508926:0:7413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869485.508973:0:7413:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c0a2f74f going to sleep for 11 seconds 00000100:00100000:0.0:1788869485.508985:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554583936 00000100:00100000:0.0:1788869485.508992:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554583936 00000100:00100000:0.0:1788869485.509029:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788869485.509038:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048d00c88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+14:7413:x1875765554583936:12345-0@lo:501: 00000100:00100000:0.0:1788869485.509178:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048d00c88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+14:7413:x1875765554583936:12345-0@lo:501: Request processed in 141us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869485.509192:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788869485.509206:0:7413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ca496de7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554583936:0@lo:501: 00000100:00100000:2.0:1788869485.509240:0:7413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ca496de7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554584064:0@lo:503: 00000100:00100000:2.0:1788869485.509313:0:7413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869485.509347:0:7413:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c0a2f74f going to sleep for 11 seconds 00000100:00100000:0.0:1788869485.509351:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554584064 00000100:00100000:0.0:1788869485.509357:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554584064 00000100:00100000:0.0:1788869485.509451:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788869485.509462:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002d6a730 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+14:7413:x1875765554584064:12345-0@lo:503: 00000040:00080000:0.0:1788869485.509499:0:6478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788869485.509562:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002d6a730 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+14:7413:x1875765554584064:12345-0@lo:503: Request processed in 104us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869485.509572:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788869485.509649:0:7413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ca496de7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554584064:0@lo:503: 00000040:00080000:2.0:1788869485.510558:0:7413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869485.510624:0:7413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1788869485.510706:0:7413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869485.511606:0:7431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1788869485.511683:0:7413:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788869485.511722:0:7413:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869485.511740:0:7413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 00000000e336a97e/0xbead52e175fc28a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc28ae expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.511761:0:7413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 00000000e336a97e/0xbead52e175fc28a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc28ae expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869485.511835:0:7413:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788869485.511838:0:7413:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ff89980800 10000000:01000000:1.0:1788869485.511841:0:7413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ff89980800 10000000:01000000:1.0:1788869485.511845:0:7413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788869485.511851:0:7413:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ff89980800 from 1 10000000:01000000:1.0:1788869485.511853:0:7413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788869485.511897:0:7413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 00000000e8e667c7/0xbead52e175fc28b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.511905:0:7413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 00000000e8e667c7/0xbead52e175fc28b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.511915:0:7413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 00000000e8e667c7/0xbead52e175fc28b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869485.511935:0:7413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e2a9cd8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554584192:0@lo:101: 00000100:00100000:1.0:1788869485.512001:0:7413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869485.512045:0:7413:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ba60338a going to sleep for 11 seconds 00000100:00100000:0.0:1788869485.512099:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554584192 00000100:00100000:0.0:1788869485.512106:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554584192 00000100:00100000:0.0:1788869485.512152:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788869485.512160:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000126e4708 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+14:7413:x1875765554584192:12345-0@lo:101: 00010000:00010000:0.0:1788869485.512173:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869485.512187:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005d7ad86d/0xbead52e175fc28bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc28b5 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.512213:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005d7ad86d/0xbead52e175fc28bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc28b5 expref: 15 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.512223:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005d7ad86d/0xbead52e175fc28bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc28b5 expref: 15 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.512232:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005d7ad86d, rc 0) 00000100:00100000:0.0:1788869485.512400:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000126e4708 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:7413:x1875765554584192:12345-0@lo:101: Request processed in 240us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869485.512406:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788869485.512495:0:7413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e2a9cd8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554584192:0@lo:101: 00010000:00010000:1.0:1788869485.512512:0:7413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 00000000e8e667c7/0xbead52e175fc28b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc28bc expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869485.512522:0:7413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 00000000e8e667c7/0xbead52e175fc28b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc28bc expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869485.512622:0:7413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e2a9cd8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554584320:0@lo:501: 00000100:00100000:1.0:1788869485.512652:0:7413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869485.512687:0:7413:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ba60338a going to sleep for 11 seconds 00000100:00080000:0.0:1788869485.512849:0:6489:0:(import.c:65:import_set_state_nolock()) 0000000098915077 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869485.512941:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b6dec45 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3615:x1875765554583296:12345-0@lo:38: Request processed in 9175us (10018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869485.512954:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869485.513127:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788869485.513136:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788869485.513144:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788869485.513150:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788869485.513152:0:3615:0:(import.c:65:import_set_state_nolock()) 00000000e4525822 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788869485.513171:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000046c0dbad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554583296:0@lo:38: 00000100:00100000:0.0:1788869485.513409:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003084d8ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554584448:0@lo:41: 00000100:00100000:0.0:1788869485.513447:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869485.513583:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554584448 00000100:00100000:0.0:1788869485.513589:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554584448 00000100:00100000:2.0:1788869485.513685:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554584320 00000100:00100000:2.0:1788869485.513697:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554584320 00000100:00100000:2.0:1788869485.513768:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788869485.513775:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b06f6771 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+15:7413:x1875765554584320:12345-0@lo:501: 00000100:00100000:2.0:1788869485.513900:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b06f6771 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+15:7413:x1875765554584320:12345-0@lo:501: Request processed in 125us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869485.513907:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788869485.514329:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869485.514338:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064d710b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1875765554584448:12345-0@lo:41: 00000004:00000024:0.0:1788869485.514367:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788869485.514414:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064d710b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1875765554584448:12345-0@lo:41: Request processed in 79us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869485.514421:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869485.514530:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003084d8ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554584448:0@lo:41: 00000100:00100000:2.0:1788869485.515086:0:7413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e2a9cd8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554584320:0@lo:501: 00000100:00100000:2.0:1788869485.515134:0:7413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ca496de7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554584576:0@lo:503: 00000100:00100000:2.0:1788869485.515197:0:7413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869485.515431:0:7413:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cd075b7b going to sleep for 11 seconds 00000100:00100000:0.0:1788869485.515529:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554584576 00000100:00100000:0.0:1788869485.515535:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554584576 00000100:00100000:0.0:1788869485.515610:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788869485.515622:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f1224c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:7413:x1875765554584576:12345-0@lo:503: 00000100:00100000:0.0:1788869485.515753:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f1224c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:7413:x1875765554584576:12345-0@lo:503: Request processed in 134us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869485.515759:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788869485.515835:0:7413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ca496de7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554584576:0@lo:503: 00000040:00080000:2.0:1788869485.516169:0:7413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788869485.516273:0:7413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ca496de7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554584704:0@lo:502: 00000100:00100000:2.0:1788869485.516312:0:7413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869485.516673:0:7413:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cd075b7b going to sleep for 11 seconds 00000100:00100000:3.0:1788869485.516775:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554584704 00000100:00100000:3.0:1788869485.516780:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554584704 00000100:00100000:3.0:1788869485.516808:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788869485.516815:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e814c1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+15:7413:x1875765554584704:12345-0@lo:502: 00000100:00100000:3.0:1788869485.516922:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e814c1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+15:7413:x1875765554584704:12345-0@lo:502: Request processed in 108us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869485.516929:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788869485.517005:0:7413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ca496de7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554584704:0@lo:502: 00000040:00080000:2.0:1788869485.517193:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788869485.517219:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788869485.517582:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788869485.517600:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788869485.517614:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788869485.517628:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788869485.517641:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788869485.517653:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788869485.517726:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788869485.517745:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788869485.517759:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788869485.517782:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788869485.517795:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788869485.517808:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788869485.517821:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788869485.517832:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788869485.517838:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788869485.517845:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788869485.517851:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788869485.517858:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788869485.517890:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788869485.517901:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788869485.517913:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788869485.517926:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788869485.517939:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788869485.517953:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788869485.517966:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788869485.517979:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1788869485.518008:0:7413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ca496de7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554584832:0@lo:502: 00000100:00100000:2.0:1788869485.518056:0:7413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869485.518165:0:7413:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cd075b7b going to sleep for 11 seconds 00000100:00100000:0.0:1788869485.518375:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554584832 00000100:00100000:0.0:1788869485.518382:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554584832 00000100:00100000:0.0:1788869485.518412:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788869485.518419:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af9c08d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:7413:x1875765554584832:12345-0@lo:502: 00000100:00100000:0.0:1788869485.518514:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af9c08d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:7413:x1875765554584832:12345-0@lo:502: Request processed in 96us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869485.518526:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788869485.518643:0:7413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ca496de7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554584832:0@lo:502: 00000040:00080000:2.0:1788869485.518701:0:7413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788869485.518709:0:7413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788869485.519076:0:7432:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788869485.519102:0:7432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000f53c1645) 00000020:00000080:2.0:1788869485.519132:0:7432:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788869485.520356:0:7432:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c68db66e from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788869485.520363:0:7432:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c68db66e from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788869485.520367:0:7432:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000c68db66e 3 00010000:00080000:0.0:1788869485.520409:0:7432:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000bc4bd4ce@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.130@tcp at head 00010000:00010000:0.0:1788869485.522167:0:7432:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1788869485.522328:0:7432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788869485.522390:0:7432:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788869485.522405:0:7432:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xbead52e175fc28ca 00000100:00080000:0.0:1788869485.522419:0:7432:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788869485.522425:0:7432:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000bc4bd4ce using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788869485.522470:0:7432:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000461ac226 x1875765554584960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869485.522499:0:7432:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788869485.522542:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000461ac226 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875765554584960:0@lo:38: 00000100:00100000:1.0:1788869485.522634:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869485.525023:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554584960 00000100:00100000:0.0:1788869485.525037:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554584960 00000100:00100000:0.0:1788869485.525091:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869485.525100:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e7e4116 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1875765554584960:12345-0@lo:38: 00010000:00080000:0.0:1788869485.525152:0:6486:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 103 last 0 00000040:00080000:1.0:1788869485.525167:0:7432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:00000080:0.0:1788869485.525201:0:6486:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xbead52e175fc28d1 00000004:00100000:0.0:1788869485.525225:0:6486:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788869485.525291:0:6486:0:(import.c:65:import_set_state_nolock()) 0000000072b4c610 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869485.525391:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e7e4116 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875765554584960:12345-0@lo:38: Request processed in 290us (2757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869485.525399:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788869485.525452:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000461ac226 x1875765554584960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869485.525465:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788869485.525489:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788869485.525503:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788869485.525508:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788869485.525511:0:3615:0:(import.c:65:import_set_state_nolock()) 00000000bc4bd4ce lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788869485.525520:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000461ac226 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875765554584960:0@lo:38: 00000020:01000000:2.0:1788869485.525749:0:7413:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788869485.525793:0:7413:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788869485.525818:0:7413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 00000000e8e667c7/0xbead52e175fc28b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc28bc expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869485.525842:0:7413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 00000000e8e667c7/0xbead52e175fc28b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc28bc expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788869485.525909:0:7413:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788869485.525912:0:7413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788869485.525914:0:7413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869485.525915:0:7413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869485.525917:0:7413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869485.525918:0:7413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869485.525920:0:7413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788869485.525922:0:7413:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788869485.525923:0:7413:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788869485.525925:0:7413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869485.525926:0:7413:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788869485.525932:0:7413:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1788869485.525935:0:7413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788869485.525937:0:7413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788869485.525939:0:7413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869485.525940:0:7413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869485.525941:0:7413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869485.525942:0:7413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869485.525943:0:7413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788869485.525944:0:7413:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788869485.525945:0:7413:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788869485.525947:0:7413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869485.525948:0:7413:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788869485.525973:0:7413:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788869485.525993:0:7413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ca496de7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554585088:0@lo:253: 00000100:00100000:2.0:1788869485.526050:0:7413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869485.526088:0:7413:0:(client.c:2702:ptlrpc_set_wait()) set 0000000064cab63a going to sleep for 11 seconds 00000100:00100000:2.0:1788869485.526109:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554585088 00000100:00100000:2.0:1788869485.526114:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554585088 00000100:00100000:2.0:1788869485.526158:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788869485.526166:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5128eb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:7413:x1875765554585088:12345-0@lo:253: 20000000:01000000:2.0:1788869485.526202:0:6476:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788869485.526218:0:6476:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:3.0:1788869485.526802:0:7434:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000001:00100000:3.0:1788869485.528417:0:6463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788869485.528483:0:6476:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788869485.528501:0:6476:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788869485.528618:0:6500:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788869485.528623:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788869485.528647:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000215c4be7/0xbead52e175fc28d8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.528688:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e3ad055c/0xbead52e175fc27f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc27f1 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.528695:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003e486a08/0xbead52e175fc2899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2892 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.528702:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000215c4be7/0xbead52e175fc28d8 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.528744:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003e486a08/0xbead52e175fc2899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2892 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.528760:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003e486a08/0xbead52e175fc2899 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2892 expref: 15 pid: 6478 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869485.528777:0:6500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000385fbb53 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1875765554585216:0@lo:104: 00000100:00100000:3.0:1788869485.528856:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869485.528926:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e3ad055c/0xbead52e175fc27f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc27f1 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.528935:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e3ad055c/0xbead52e175fc27f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc27f1 expref: 15 pid: 6479 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869485.528943:0:6500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c16bf0e1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1875765554585344:0@lo:104: 00000100:00100000:3.0:1788869485.528965:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869485.528987:0:6500:0:(client.c:2702:ptlrpc_set_wait()) set 000000002bd42b89 going to sleep for 11 seconds 00000100:00100000:2.0:1788869485.529046:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554585216 00000100:00100000:2.0:1788869485.529054:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554585216 00000100:00100000:2.0:1788869485.529090:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554585344 00000100:00100000:2.0:1788869485.529092:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554585344 00000100:00100000:2.0:1788869485.529106:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869485.529113:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000608025d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+4:6500:x1875765554585216:12345-0@lo:104: 00010000:00010000:2.0:1788869485.529128:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc2892 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2899 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869485.529203:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788869485.529209:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000608025d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+4:6500:x1875765554585216:12345-0@lo:104: Request processed in 96us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869485.529217:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788869485.529224:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869485.529234:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc2892 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2899 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869485.529237:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869485.529242:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000536754da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+3:6500:x1875765554585344:12345-0@lo:104: 00010000:00010000:2.0:1788869485.529249:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: 00000000efe8350f/0xbead52e175fc27f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc27f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.529282:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004f67f551 already unused, calling callback (00000000cb5a5c96) 10000000:00010000:0.0:1788869485.529288:0:7425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc2892 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2899 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.529298:0:7425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc2892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2899 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869485.529305:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:0.0:1788869485.529305:0:7425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc2892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2899 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869485.529312:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000536754da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+3:6500:x1875765554585344:12345-0@lo:104: Request processed in 70us (347us total) trans 0 rc 0/0 10000000:01000000:0.0:1788869485.529322:0:7425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1788869485.529324:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788869485.529338:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869485.529343:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: 00000000efe8350f/0xbead52e175fc27f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc27f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869485.529358:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000efe8350f already unused, calling callback (00000000cb5a5c96) 10000000:00010000:2.0:1788869485.529359:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: 00000000efe8350f/0xbead52e175fc27f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc27f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869485.529363:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: 00000000efe8350f/0xbead52e175fc27f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc27f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869485.529367:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: 00000000efe8350f/0xbead52e175fc27f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc27f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869485.529370:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869485.529385:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: 00000000efe8350f/0xbead52e175fc27f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc27f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.529385:0:7425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc2892 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2899 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869485.529402:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869485.529406:0:7425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869485.529423:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: 00000000efe8350f/0xbead52e175fc27f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc27f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869485.529429:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: 00000000efe8350f/0xbead52e175fc27f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc27f8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.529434:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc2892 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2899 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869485.529440:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869485.529442:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869485.529442:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: 000000004f67f551/0xbead52e175fc2892 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2899 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869485.529445:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869485.529456:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f5cd4544 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554585600:0@lo:103: 00000100:00100000:0.0:1788869485.529475:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000e146803 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554585472:0@lo:103: 00000100:00100000:2.0:1788869485.529482:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869485.529522:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554585600 00000100:00100000:0.0:1788869485.529522:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869485.529526:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554585600 00010000:00010000:2.0:1788869485.529541:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e3ad055c/0xbead52e175fc27f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc27f1 expref: 16 pid: 6479 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869485.529564:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554585472 00000100:00100000:2.0:1788869485.529566:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554585472 00010000:00010000:2.0:1788869485.529574:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003e486a08/0xbead52e175fc2899 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2892 expref: 17 pid: 6478 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869485.529586:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788869485.529596:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b190bb44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+17:3617:x1875765554585600:12345-0@lo:103: 00010000:00010000:0.0:1788869485.529608:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869485.529615:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e3ad055c/0xbead52e175fc27f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc27f1 expref: 17 pid: 6479 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.529636:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e3ad055c/0xbead52e175fc27f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc27f1 expref: 17 pid: 6479 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869485.529640:0:6500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000385fbb53 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1875765554585216:0@lo:104: 00000100:00100000:3.0:1788869485.529650:0:6500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c16bf0e1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1875765554585344:0@lo:104: 00010000:00010000:0.0:1788869485.529659:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e3ad055c/0xbead52e175fc27f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc27f1 expref: 17 pid: 6479 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.529675:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869485.529678:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000215c4be7/0xbead52e175fc28d8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869485.529721:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b190bb44 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+16:3617:x1875765554585600:12345-0@lo:103: Request processed in 127us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869485.529827:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f5cd4544 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554585600:0@lo:103: 00000100:00100000:2.0:1788869485.529935:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869485.529943:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869485.529947:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6866ed0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46892796-b77d-4866-a7cc-ce4160dea4be+16:3618:x1875765554585472:12345-0@lo:103: 00010000:00010000:2.0:1788869485.529957:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869485.529961:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003e486a08/0xbead52e175fc2899 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2892 expref: 15 pid: 6478 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869485.529969:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003e486a08/0xbead52e175fc2899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2892 expref: 15 pid: 6478 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869485.529972:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869485.529977:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869485.529981:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869485.529983:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003e486a08/0xbead52e175fc2899 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2892 expref: 15 pid: 6478 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869485.529987:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5128eb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:7413:x1875765554585088:12345-0@lo:253: Request processed in 3823us (3938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869485.529996:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1788869485.529996:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000215c4be7/0xbead52e175fc28d8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869485.530003:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000215c4be7/0xbead52e175fc28d8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788869485.530015:0:6471:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002539960s 00010000:00010000:2.0:1788869485.530019:0:6471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000215c4be7/0xbead52e175fc28d8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869485.530026:0:6471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000215c4be7/0xbead52e175fc28d8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869485.530042:0:6471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000215c4be7/0xbead52e175fc28d8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869485.530047:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000215c4be7/0xbead52e175fc28d8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869485.530050:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000215c4be7 already unused, calling callback (000000000b2a4490) 00010000:00010000:2.0:1788869485.530052:0:6471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000215c4be7/0xbead52e175fc28d8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869485.530057:0:6471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000215c4be7/0xbead52e175fc28d8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869485.530068:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000215c4be7/0xbead52e175fc28d8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869485.530077:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869485.530086:0:6500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000215c4be7/0xbead52e175fc28d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.530092:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000215c4be7/0xbead52e175fc28d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869485.530098:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000215c4be7/0xbead52e175fc28d8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869485.530990:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6866ed0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46892796-b77d-4866-a7cc-ce4160dea4be+13:3618:x1875765554585472:12345-0@lo:103: Request processed in 1043us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869485.531000:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869485.531078:0:7413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ca496de7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:7413:1875765554585088:0@lo:253: 10000000:01000000:2.0:1788869485.531093:0:7413:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788869485.531097:0:7413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788869485.531099:0:7413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788869485.531100:0:7413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869485.531101:0:7413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869485.531102:0:7413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869485.531103:0:7413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869485.531105:0:7413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788869485.531106:0:7413:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788869485.531108:0:7413:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788869485.531120:0:7413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869485.531122:0:7413:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788869485.531138:0:7413:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788869485.534049:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000e146803 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554585472:0@lo:103: 00080000:10000000:2.0:1788869485.535461:0:7413:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1788869485.535657:0:7413:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788869485.536114:0:7413:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788869485.536773:0:7413:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788869485.537035:0:7413:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788869485.537246:0:7413:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1788869485.538199:0:7413:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788869485.538684:0:7413:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788869485.538855:0:7413:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1788869485.539020:0:7413:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788869485.539170:0:7413:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1788869485.539313:0:7413:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1788869485.540560:0:7413:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1788869485.540772:0:7437:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788869485.540777:0:7437:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788869485.540872:0:7438:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1788869485.540941:0:7438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c16bf0e1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7438:1875765554585728:0@lo:700: 00000100:00100000:3.0:1788869485.541035:0:7438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869485.541098:0:7438:0:(client.c:2702:ptlrpc_set_wait()) set 0000000019a725ef going to sleep for 11 seconds 00000100:00100000:0.0:1788869485.541159:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554585728 00000100:00100000:0.0:1788869485.541169:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554585728 00000100:00100000:0.0:1788869485.541229:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869485.541238:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000385fbb53 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7438:x1875765554585728:12345-0@lo:700: 00000040:01000000:2.0:1788869485.541454:0:7413:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1788869485.541885:0:7439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ca496de7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7439:1875765554585856:0@lo:1000: 00000100:00100000:2.0:1788869485.541943:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869485.542013:0:7439:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cc7c8321 going to sleep for 11 seconds 00000040:01000000:3.0:1788869485.542485:0:7413:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788869485.542611:0:7413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788869485.543157:0:7413:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788869485.543167:0:7413:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788869485.543345:0:7413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788869485.544972:0:7413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1788869485.545189:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554585856 00000100:00100000:0.0:1788869485.545203:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554585856 00000100:00100000:0.0:1788869485.545287:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869485.545298:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034c0e10d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7439:x1875765554585856:12345-0@lo:1000: 00000040:00080000:2.0:1788869485.546575:0:7413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788869485.546638:0:7413:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788869485.546949:0:7413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788869485.547166:0:7413:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:0.0:1788869485.547579:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034c0e10d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7439:x1875765554585856:12345-0@lo:1000: Request processed in 2279us (5632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869485.547593:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869485.548464:0:7439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ca496de7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7439:1875765554585856:0@lo:1000: 00000040:01000000:0.0:1788869485.548506:0:7439:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1788869485.548556:0:7439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000e146803 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7439:1875765554585984:0@lo:700: 00000100:00100000:0.0:1788869485.548613:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00100000:10000000:2.0:1788869485.548838:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788869485.548983:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788869485.549112:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788869485.549244:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00000100:00100000:0.0:1788869485.549362:0:7439:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c9a966d6 going to sleep for 11 seconds 00100000:10000000:2.0:1788869485.549601:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788869485.549756:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788869485.549908:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788869485.550106:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788869485.550431:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788869485.550615:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788869485.550753:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788869485.550897:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788869485.551054:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788869485.551198:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00000100:00100000:1.0:1788869485.551366:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554585984 00000100:00100000:1.0:1788869485.551377:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554585984 00000100:00100000:1.0:1788869485.551441:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869485.551453:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abfa9bb7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7439:x1875765554585984:12345-0@lo:700: 00000100:00100000:1.0:1788869485.551567:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abfa9bb7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7439:x1875765554585984:12345-0@lo:700: Request processed in 117us (2953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869485.551575:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 40000000:02000000:1.0:1788869485.551607:0:6491:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:2.0:1788869485.551942:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788869485.552079:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788869485.552402:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788869485.552528:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788869485.552658:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788869485.552808:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788869485.552947:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788869485.553072:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788869485.553209:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00000100:00100000:0.0:1788869485.553505:0:7439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000e146803 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7439:1875765554585984:0@lo:700: 00000100:00100000:0.0:1788869485.553592:0:7439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000e146803 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7439:1875765554586112:0@lo:900: 00000100:00100000:0.0:1788869485.553651:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869485.553679:0:7439:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c9a966d6 going to sleep for 11 seconds 00000100:00100000:0.0:1788869485.553805:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554586112 00000100:00100000:0.0:1788869485.553812:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554586112 00100000:10000000:2.0:1788869485.554028:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788869485.554161:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788869485.554301:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788869485.554426:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788869485.554563:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788869485.554711:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788869485.554843:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00000100:00100000:0.0:1788869485.554917:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869485.554927:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdfcf173 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7439:x1875765554586112:12345-0@lo:900: 00000100:00100000:0.0:1788869485.554998:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdfcf173 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7439:x1875765554586112:12345-0@lo:900: Request processed in 73us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869485.555005:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:2.0:1788869485.555140:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788869485.555281:0:7413:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788869485.555479:0:7413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788869485.555827:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000385fbb53 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7438:x1875765554585728:12345-0@lo:700: Request processed in 14529us (14733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869485.555842:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788869485.555929:0:7438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c16bf0e1 x1875765554585728/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788869501 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869485.555954:0:7438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c16bf0e1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7438:1875765554585728:0@lo:700: 40000000:02000000:1.0:1788869485.555966:0:7438:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00010000:00080000:0.0:1788869485.556475:0:7439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000e146803 x1875765554586112/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788869501 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869485.556485:0:7439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000e146803 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7439:1875765554586112:0@lo:900: 00000100:00100000:0.0:1788869485.556604:0:7439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000e146803 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7439:1875765554586240:0@lo:1000: 00000100:00100000:0.0:1788869485.556649:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869485.556727:0:7439:0:(client.c:2702:ptlrpc_set_wait()) set 0000000083b61c85 going to sleep for 11 seconds 00000100:00100000:3.0:1788869485.556778:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554586240 00000100:00100000:3.0:1788869485.556785:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554586240 00000100:00100000:3.0:1788869485.556880:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869485.556887:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019e7e764 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7439:x1875765554586240:12345-0@lo:1000: 00000100:00100000:3.0:1788869485.556971:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019e7e764 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7439:x1875765554586240:12345-0@lo:1000: Request processed in 85us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869485.556977:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788869485.557027:0:7439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000e146803 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7439:1875765554586240:0@lo:1000: 00000004:00080000:2.0:1788869485.557074:0:7439:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000c9a966d6 with version 0 00000020:00100000:2.0:1788869485.557090:0:7439:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788869485.557095:0:7439:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000048d2651d x1875765554586496/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788869485.557107:0:7439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000048d2651d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7439:1875765554586496:0@lo:1000: 00000100:00100000:2.0:1788869485.557136:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869485.557192:0:7439:0:(client.c:2702:ptlrpc_set_wait()) set 000000009f49d41c going to sleep for 11 seconds 00000100:00100000:0.0:1788869485.557225:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554586496 00000100:00100000:0.0:1788869485.557228:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554586496 00000100:00100000:0.0:1788869485.557247:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788869485.557362:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b190bb44 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7439:x1875765554586496:12345-0@lo:1000: 00000001:00080000:3.0:1788869485.561163:0:7413:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788869485.561206:0:7413:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb76cc1c8f988 00100000:10000000:3.0:1788869485.561215:0:7413:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788869485.562729:0:7413:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788869485.562775:0:7413:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788869485.562802:0:7413:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788869485.562823:0:7413:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788869485.563823:0:7413:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788869485.564085:0:7413:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000001:00080000:3.0:1788869485.570369:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:1.0:1788869485.570576:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b190bb44 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7439:x1875765554586496:12345-0@lo:1000: Request processed in 13209us (13431us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788869485.570599:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1788869485.570608:0:7439:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1788869485.570613:0:7439:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788869485.570633:0:7439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000048d2651d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7439:1875765554586496:0@lo:1000: 00000100:00100000:3.0:1788869485.570753:0:7439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c16bf0e1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7439:1875765554586624:0@lo:1000: 00000100:00100000:3.0:1788869485.570883:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869485.570941:0:7439:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c92f3055 going to sleep for 11 seconds 00000100:00100000:2.0:1788869485.574131:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554586624 00000100:00100000:2.0:1788869485.574150:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554586624 00000100:00100000:2.0:1788869485.574311:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869485.574325:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003084d8ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7439:x1875765554586624:12345-0@lo:1000: 00000100:00100000:2.0:1788869485.574596:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003084d8ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7439:x1875765554586624:12345-0@lo:1000: Request processed in 274us (3715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869485.574606:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869485.574721:0:7439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c16bf0e1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7439:1875765554586624:0@lo:1000: 00000040:00080000:2.0:1788869485.574757:0:7439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788869485.575486:0:7439:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000003333defe with version 1 00000040:00080000:0.0:1788869485.577836:0:7439:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788869485.577943:0:7439:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788869485.578953:0:7429:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000006b973592 version 1 rpc_version 1 00000020:00100000:1.0:1788869485.579004:0:7429:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788869485.579016:0:7429:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000001df13016 x1875765554586880/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869485.579046:0:7429:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001df13016 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7429:1875765554586880:0@lo:1000: 00000100:00100000:1.0:1788869485.579145:0:7429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869485.579201:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554586880 00000100:00100000:1.0:1788869485.579209:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554586880 00000100:00100000:1.0:1788869485.579300:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788869485.579311:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a381c771 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7429:x1875765554586880:12345-0@lo:1000: 00000100:00100000:1.0:1788869485.579666:0:7429:0:(client.c:2702:ptlrpc_set_wait()) set 00000000781bd093 going to sleep for 11 seconds 00000040:00080000:2.0:1788869485.581101:0:7438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788869485.581167:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1788869485.581312:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a381c771 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7429:x1875765554586880:12345-0@lo:1000: Request processed in 2000us (2165us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788869485.581323:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1788869485.582536:0:7429:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788869485.582552:0:7429:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788869485.582577:0:7429:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001df13016 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7429:1875765554586880:0@lo:1000: 00000040:00080000:0.0:1788869485.588572:0:7438:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788869485.588664:0:7438:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788869485.588670:0:7438:0:(lod_dev.c:546:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1788869486.489889:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869487.512388:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788869487.726175:0:7683:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:3.0:1788869488.220363:0:7735:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788869488.220550:0:7735:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788869488.536686:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788869488.856359:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788869488.856367:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ff89980800 from 4 10000000:01000000:1.0:1788869488.856373:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788869488.856420:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 0000000008e31d89/0xbead52e175fc28df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869488.856432:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 0000000008e31d89/0xbead52e175fc28df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869488.856443:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 0000000008e31d89/0xbead52e175fc28df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869488.856466:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001df13016 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554587008:0@lo:101: 00000100:00100000:1.0:1788869488.856541:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869488.856617:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554587008 00000100:00100000:1.0:1788869488.856624:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set 00000000442782ad going to sleep for 11 seconds 00000100:00100000:3.0:1788869488.856625:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554587008 00000100:00100000:3.0:1788869488.856692:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788869488.856699:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c50290d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+13:6481:x1875765554587008:12345-0@lo:101: 00010000:00010000:3.0:1788869488.856711:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869488.856724:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000095cc9e2a/0xbead52e175fc28e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc28df expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869488.856748:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000095cc9e2a/0xbead52e175fc28e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc28df expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869488.856758:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000095cc9e2a/0xbead52e175fc28e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc28df expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869488.856767:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000095cc9e2a, rc 0) 00000100:00100000:3.0:1788869488.856824:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c50290d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+14:6481:x1875765554587008:12345-0@lo:101: Request processed in 126us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869488.856832:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788869488.857867:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001df13016 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554587008:0@lo:101: 00010000:00010000:1.0:1788869488.857885:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 0000000008e31d89/0xbead52e175fc28df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc28e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869488.857896:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 0000000008e31d89/0xbead52e175fc28df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc28e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869488.857946:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001df13016 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554587136:0@lo:256: 00000100:00100000:1.0:1788869488.857984:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869488.858014:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set 00000000442782ad going to sleep for 11 seconds 00000100:00100000:3.0:1788869488.858035:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554587136 00000100:00100000:3.0:1788869488.858041:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554587136 00000100:00100000:3.0:1788869488.858080:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788869488.858089:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088df636d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+14:6481:x1875765554587136:12345-0@lo:256: 20000000:01000000:3.0:1788869488.858106:0:6476:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788869488.858123:0:6476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788869488.858126:0:6476:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788869488.858319:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088df636d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+14:6481:x1875765554587136:12345-0@lo:256: Request processed in 231us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869488.858328:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788869488.858404:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001df13016 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554587136:0@lo:256: 10000000:01000000:1.0:1788869488.858450:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788869488.858456:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 0000000008e31d89/0xbead52e175fc28df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc28e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869488.858465:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 0000000008e31d89/0xbead52e175fc28df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc28e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869488.858473:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788869488.858475:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ff8b15e800 from 21 10000000:01000000:1.0:1788869488.858478:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788869488.858495:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 00000000e3ad055c/0xbead52e175fc28ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869488.858502:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 00000000e3ad055c/0xbead52e175fc28ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869488.858509:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 00000000e3ad055c/0xbead52e175fc28ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869488.858520:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001df13016 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554587264:0@lo:101: 00000100:00100000:1.0:1788869488.858546:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869488.858569:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set 00000000442782ad going to sleep for 11 seconds 00000100:00100000:3.0:1788869488.858589:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554587264 00000100:00100000:3.0:1788869488.858593:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554587264 00000100:00100000:3.0:1788869488.858627:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788869488.858637:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8e104e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+14:6481:x1875765554587264:12345-0@lo:101: 00010000:00010000:3.0:1788869488.858645:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869488.858655:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000215c4be7/0xbead52e175fc28f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc28ed expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869488.858671:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000215c4be7/0xbead52e175fc28f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc28ed expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869488.858680:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000215c4be7/0xbead52e175fc28f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc28ed expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869488.858687:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000215c4be7, rc 0) 00000100:00100000:3.0:1788869488.858718:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8e104e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+15:6481:x1875765554587264:12345-0@lo:101: Request processed in 81us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869488.858723:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788869488.858831:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001df13016 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554587264:0@lo:101: 00010000:00010000:1.0:1788869488.858839:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 00000000e3ad055c/0xbead52e175fc28ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc28f4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869488.858845:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 00000000e3ad055c/0xbead52e175fc28ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc28f4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869488.858899:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001df13016 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554587392:0@lo:501: 00000100:00100000:1.0:1788869488.858923:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869488.858939:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set 00000000442782ad going to sleep for 11 seconds 00000100:00100000:3.0:1788869488.858966:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554587392 00000100:00100000:3.0:1788869488.858971:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554587392 00000100:00100000:3.0:1788869488.859000:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788869488.859006:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039381deb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:6481:x1875765554587392:12345-0@lo:501: 00000100:00100000:3.0:1788869488.859107:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039381deb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:6481:x1875765554587392:12345-0@lo:501: Request processed in 102us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869488.859112:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788869488.859169:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001df13016 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554587392:0@lo:501: 00000100:00100000:1.0:1788869488.859196:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001df13016 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554587520:0@lo:503: 00000100:00100000:1.0:1788869488.859243:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869488.859303:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set 00000000442782ad going to sleep for 11 seconds 00000100:00100000:3.0:1788869488.859328:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554587520 00000100:00100000:3.0:1788869488.859331:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554587520 00000100:00100000:3.0:1788869488.859352:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788869488.859356:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000164a4cc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+15:6481:x1875765554587520:12345-0@lo:503: 00000100:00100000:3.0:1788869488.859437:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000164a4cc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+15:6481:x1875765554587520:12345-0@lo:503: Request processed in 76us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869488.859452:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788869488.859477:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001df13016 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554587520:0@lo:503: 00000100:00100000:2.0:1788869488.859781:0:7787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dfe29d33 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:7787:1875765554587648:0@lo:502: 00000100:00100000:2.0:1788869488.859820:0:7787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869488.859835:0:7787:0:(client.c:2702:ptlrpc_set_wait()) set 00000000955bb5ff going to sleep for 11 seconds 00000100:00100000:3.0:1788869488.859854:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554587648 00000100:00100000:3.0:1788869488.859858:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554587648 00000100:00100000:3.0:1788869488.859879:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788869488.859885:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3dba8d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:7787:x1875765554587648:12345-0@lo:502: 00000100:00100000:3.0:1788869488.859948:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3dba8d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:7787:x1875765554587648:12345-0@lo:502: Request processed in 64us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869488.859955:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788869488.859973:0:7787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dfe29d33 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:7787:1875765554587648:0@lo:502: 00000100:00100000:2.0:1788869488.860006:0:7787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dfe29d33 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:7787:1875765554587776:0@lo:502: 00000100:00100000:2.0:1788869488.860032:0:7787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869488.860089:0:7787:0:(client.c:2702:ptlrpc_set_wait()) set 00000000955bb5ff going to sleep for 11 seconds 00000100:00100000:1.0:1788869488.860114:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554587776 00000100:00100000:1.0:1788869488.860117:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554587776 00000100:00100000:1.0:1788869488.860141:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788869488.860157:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000875007ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+15:7787:x1875765554587776:12345-0@lo:502: 00000100:00100000:1.0:1788869488.860229:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000875007ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+15:7787:x1875765554587776:12345-0@lo:502: Request processed in 73us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869488.860234:0:7787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dfe29d33 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:7787:1875765554587776:0@lo:502: 00000100:00100000:1.0:1788869488.860236:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000040:00080000:2.0:1788869488.860267:0:7787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788869488.860395:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788869488.860410:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788869488.860416:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 00000000e3ad055c/0xbead52e175fc28ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc28f4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869488.860422:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 00000000e3ad055c/0xbead52e175fc28ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc28f4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869488.860427:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788869488.860428:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ff8b15e800 from 4 10000000:01000000:3.0:1788869488.860430:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788869488.860445:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 00000000825d742f/0xbead52e175fc28fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869488.860449:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 00000000825d742f/0xbead52e175fc28fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869488.860454:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 00000000825d742f/0xbead52e175fc28fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869488.860461:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000046c0dbad pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554587904:0@lo:101: 00000100:00100000:3.0:1788869488.860483:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869488.860523:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b668fdc9 going to sleep for 11 seconds 00000100:00100000:2.0:1788869488.860547:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554587904 00000100:00100000:2.0:1788869488.860550:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554587904 00000100:00100000:2.0:1788869488.860616:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788869488.860623:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e6621cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:6481:x1875765554587904:12345-0@lo:101: 00010000:00010000:2.0:1788869488.860630:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869488.860639:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000705a0d9f/0xbead52e175fc2902 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc28fb expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869488.860655:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000705a0d9f/0xbead52e175fc2902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc28fb expref: 16 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869488.860662:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000705a0d9f/0xbead52e175fc2902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc28fb expref: 16 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869488.860668:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000705a0d9f, rc 0) 00000100:00100000:2.0:1788869488.860705:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e6621cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:6481:x1875765554587904:12345-0@lo:101: Request processed in 84us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869488.860711:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788869488.860767:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000046c0dbad pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554587904:0@lo:101: 00010000:00010000:1.0:1788869488.860778:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 00000000825d742f/0xbead52e175fc28fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2902 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869488.860786:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 00000000825d742f/0xbead52e175fc28fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2902 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869488.860837:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001df13016 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554588032:0@lo:256: 00000100:00100000:1.0:1788869488.860866:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869488.860890:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554588032 00000100:00100000:2.0:1788869488.860893:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554588032 00000100:00100000:1.0:1788869488.860894:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set 0000000040579bd1 going to sleep for 11 seconds 00000100:00100000:2.0:1788869488.860949:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788869488.860953:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de4fd33b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:6481:x1875765554588032:12345-0@lo:256: 20000000:01000000:2.0:1788869488.860966:0:6476:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788869488.860976:0:6476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788869488.860978:0:6476:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788869488.861047:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de4fd33b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:6481:x1875765554588032:12345-0@lo:256: Request processed in 94us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869488.861054:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788869488.861060:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001df13016 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554588032:0@lo:256: 10000000:01000000:1.0:1788869488.861094:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788869488.861098:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 00000000825d742f/0xbead52e175fc28fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2902 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869488.861105:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 00000000825d742f/0xbead52e175fc28fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2902 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869488.861112:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788869488.861114:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788869488.861116:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788869488.861128:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 00000000b112619d/0xbead52e175fc2909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869488.861135:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 00000000b112619d/0xbead52e175fc2909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869488.861141:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 00000000b112619d/0xbead52e175fc2909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869488.861198:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001df13016 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554588160:0@lo:101: 00000100:00100000:1.0:1788869488.861276:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869488.861299:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set 0000000040579bd1 going to sleep for 11 seconds 00000100:00100000:3.0:1788869488.861311:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554588160 00000100:00100000:3.0:1788869488.861315:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554588160 00000100:00100000:3.0:1788869488.861337:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788869488.861341:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c199e42f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+16:6481:x1875765554588160:12345-0@lo:101: 00010000:00010000:3.0:1788869488.861348:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869488.861355:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003665a10c/0xbead52e175fc2910 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2909 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869488.861367:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003665a10c/0xbead52e175fc2910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2909 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869488.861375:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003665a10c/0xbead52e175fc2910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2909 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869488.861381:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003665a10c, rc 0) 00000100:00100000:3.0:1788869488.861411:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c199e42f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554588160:12345-0@lo:101: Request processed in 70us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869488.861416:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788869488.861434:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001df13016 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554588160:0@lo:101: 00010000:00010000:1.0:1788869488.861443:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 00000000b112619d/0xbead52e175fc2909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869488.861450:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 00000000b112619d/0xbead52e175fc2909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869488.861501:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001df13016 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554588288:0@lo:501: 00000100:00100000:1.0:1788869488.861523:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869488.861537:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set 0000000040579bd1 going to sleep for 11 seconds 00000100:00100000:0.0:1788869488.861556:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554588288 00000100:00100000:0.0:1788869488.861639:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554588288 00000100:00100000:0.0:1788869488.861698:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788869488.861704:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003373ccc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554588288:12345-0@lo:501: 00000100:00100000:0.0:1788869488.861804:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003373ccc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554588288:12345-0@lo:501: Request processed in 88us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869488.861811:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788869488.861828:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001df13016 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554588288:0@lo:501: 00000100:00100000:1.0:1788869488.861865:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001df13016 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554588416:0@lo:503: 00000100:00100000:1.0:1788869488.861901:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869488.861917:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set 0000000040579bd1 going to sleep for 11 seconds 00000100:00100000:2.0:1788869488.861929:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554588416 00000100:00100000:2.0:1788869488.861933:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554588416 00000100:00100000:2.0:1788869488.861986:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788869488.861991:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000979d9759 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554588416:12345-0@lo:503: 00000100:00100000:2.0:1788869488.862055:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000979d9759 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554588416:12345-0@lo:503: Request processed in 64us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869488.862061:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788869488.862080:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001df13016 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554588416:0@lo:503: 00000100:00100000:1.0:1788869488.862420:0:7788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001df13016 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:7788:1875765554588544:0@lo:502: 00000100:00100000:1.0:1788869488.862443:0:7788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869488.862463:0:7788:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eb058335 going to sleep for 11 seconds 00000100:00100000:0.0:1788869488.862477:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554588544 00000100:00100000:0.0:1788869488.862481:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554588544 00000100:00100000:0.0:1788869488.862535:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788869488.862540:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008610e84c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+17:7788:x1875765554588544:12345-0@lo:502: 00000100:00100000:0.0:1788869488.862684:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008610e84c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+17:7788:x1875765554588544:12345-0@lo:502: Request processed in 144us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869488.862690:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788869488.862708:0:7788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001df13016 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:7788:1875765554588544:0@lo:502: 00000020:01000000:1.0:1788869488.862725:0:7788:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869488.862736:0:7788:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869488.862738:0:7788:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788869488.862745:0:7788:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788869488.862749:0:7788:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:00000080:1.0:1788869488.862771:0:7788:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788869488.862785:0:7788:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000c0cda34d) 00000020:00000080:1.0:1788869488.862814:0:7788:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1788869488.862820:0:7788:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788869488.862892:0:7788:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788869488.862895:0:7788:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788869488.862901:0:7788:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbead52e175fc291e 00010000:00080000:1.0:1788869488.862923:0:7788:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000076834c92@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:1.0:1788869488.864147:0:7788:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1788869488.864928:0:7788:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788869488.864936:0:7788:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788869488.864962:0:7788:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788869488.864977:0:7788:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbead52e175fc2925 00000100:00080000:0.0:1788869488.864984:0:7788:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788869488.864987:0:7788:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000076834c92 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788869488.865012:0:7788:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003656cf47 x1875765554588672/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869488.865055:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003656cf47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554588672:0@lo:38: 00000100:00100000:1.0:1788869488.865101:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869488.865136:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554588672 00000100:00100000:2.0:1788869488.865142:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554588672 00000100:00080000:0.0:1788869488.865153:0:7788:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788869488.865174:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869488.865180:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001df13016 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3615:x1875765554588672:12345-0@lo:38: 00010000:00080000:2.0:1788869488.865200:0:6490:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 106 last 0 00000020:00000080:2.0:1788869488.865228:0:6490:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbead52e175fc292c 00000100:00100000:0.0:1788869488.865237:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000003c3f262 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554588800:0@lo:400: 00000004:00100000:2.0:1788869488.865243:0:6490:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788869488.865248:0:6490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788869488.865285:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869488.865318:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009f71742d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554589056:0@lo:400: 00000100:00100000:2.0:1788869488.865321:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000aa15dd4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554588928:0@lo:400: 00000100:00100000:0.0:1788869488.865341:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869488.865377:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554588800 00000100:00100000:0.0:1788869488.865382:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554588800 00000100:00100000:0.0:1788869488.865408:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554589056 00000100:00100000:0.0:1788869488.865411:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554589056 00000100:00100000:0.0:1788869488.865424:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869488.865429:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e146803 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554588800:12345-0@lo:400: 00000100:00100000:2.0:1788869488.865442:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869488.865469:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e146803 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554588800:12345-0@lo:400: Request processed in 40us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869488.865476:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869488.865490:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869488.865495:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eae045ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554589056:12345-0@lo:400: 00000100:00100000:3.0:1788869488.865527:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788869488.865530:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eae045ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554589056:12345-0@lo:400: Request processed in 36us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869488.865536:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788869488.865536:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788869488.865568:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000003c3f262 x1875765554588800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869488.865579:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000003c3f262 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554588800:0@lo:400: 00000040:01000000:0.0:1788869488.865612:0:7788:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00010000:00080000:2.0:1788869488.865652:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009f71742d x1875765554589056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869488.865661:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009f71742d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554589056:0@lo:400: 00000100:00100000:1.0:1788869488.865998:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554588928 00000100:00100000:1.0:1788869488.866002:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554588928 00000100:00100000:0.0:1788869488.866110:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788869488.866116:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfe29d33 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554588928:12345-0@lo:400: 00000100:00080000:2.0:1788869488.866171:0:7792:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@0000000099f250c0 x1875765554589184/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869488.866180:0:7792:0:(client.c:2702:ptlrpc_set_wait()) set 0000000057e52e16 going to sleep for 0 seconds 00000100:00100000:0.0:1788869488.866205:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfe29d33 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554588928:12345-0@lo:400: Request processed in 89us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869488.866215:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000aa15dd4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554588928:0@lo:400: 00000100:00100000:0.0:1788869488.866293:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000020:01000000:3.0:1788869488.866382:0:7788:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869488.866387:0:7788:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869488.866390:0:7788:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788869488.866393:0:7788:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869488.866397:0:7788:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869488.866398:0:7788:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788869488.866401:0:7788:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788869488.866402:0:7788:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788869488.866421:0:7788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d682acbb pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:7788:1875765554589312:0@lo:502: 00000100:00100000:3.0:1788869488.866459:0:7788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869488.866484:0:7788:0:(client.c:2702:ptlrpc_set_wait()) set 0000000054dda67f going to sleep for 11 seconds 00000100:00100000:0.0:1788869488.866489:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554589312 00000100:00100000:0.0:1788869488.866493:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554589312 00000100:00100000:0.0:1788869488.866522:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788869488.866528:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012ce444e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+17:7788:x1875765554589312:12345-0@lo:502: 00000100:00100000:0.0:1788869488.866657:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012ce444e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+17:7788:x1875765554589312:12345-0@lo:502: Request processed in 130us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869488.866664:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788869488.866713:0:7788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d682acbb pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:7788:1875765554589312:0@lo:502: 00000020:01000000:1.0:1788869488.866727:0:7788:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869488.866729:0:7788:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869488.866730:0:7788:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788869488.866733:0:7788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788869488.866807:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788869488.866826:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788869488.866834:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 00000000b112619d/0xbead52e175fc2909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869488.866844:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 00000000b112619d/0xbead52e175fc2909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869488.866852:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788869488.866854:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99ff8b770000 from 1 10000000:01000000:3.0:1788869488.866855:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788869488.866879:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 0000000071b8f707/0xbead52e175fc2933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869488.866884:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 0000000071b8f707/0xbead52e175fc2933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869488.866890:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 0000000071b8f707/0xbead52e175fc2933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869488.866897:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009c50f244 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554589440:0@lo:101: 00000100:00100000:3.0:1788869488.866914:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869488.866928:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set 00000000caf9332b going to sleep for 11 seconds 00000100:00100000:0.0:1788869488.866943:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554589440 00000100:00100000:0.0:1788869488.866946:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554589440 00000100:00100000:0.0:1788869488.866967:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788869488.866973:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005572eec1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554589440:12345-0@lo:101: 00010000:00010000:0.0:1788869488.866980:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869488.866991:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003e486a08/0xbead52e175fc293a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2933 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869488.867008:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e486a08/0xbead52e175fc293a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2933 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869488.867017:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003e486a08/0xbead52e175fc293a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2933 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869488.867024:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003e486a08, rc 0) 00000100:00100000:0.0:1788869488.867049:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005572eec1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554589440:12345-0@lo:101: Request processed in 77us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869488.867055:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788869488.867064:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009c50f244 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554589440:0@lo:101: 00010000:00010000:3.0:1788869488.867076:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 0000000071b8f707/0xbead52e175fc2933 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc293a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869488.867084:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 0000000071b8f707/0xbead52e175fc2933 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc293a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869488.867131:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009c50f244 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554589568:0@lo:501: 00000100:00100000:3.0:1788869488.867152:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869488.867170:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set 00000000caf9332b going to sleep for 11 seconds 00000100:00100000:0.0:1788869488.867284:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554589568 00000100:00100000:0.0:1788869488.867288:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554589568 00000100:00100000:0.0:1788869488.867314:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788869488.867319:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae875f82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554589568:12345-0@lo:501: 00000100:00100000:0.0:1788869488.867371:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae875f82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554589568:12345-0@lo:501: Request processed in 52us (218us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788869488.867377:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788869488.867385:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009c50f244 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554589568:0@lo:501: 10000000:01000000:3.0:1788869488.867403:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788869488.867408:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 0000000071b8f707/0xbead52e175fc2933 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc293a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869488.867414:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 0000000071b8f707/0xbead52e175fc2933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc293a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788869488.875512:0:6490:0:(import.c:65:import_set_state_nolock()) 00000000ff8ead5c : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869488.875636:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001df13016 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3615:x1875765554588672:12345-0@lo:38: Request processed in 10454us (10533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869488.875647:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788869488.875665:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788869488.875675:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788869488.875683:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788869488.875688:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788869488.875690:0:3615:0:(import.c:65:import_set_state_nolock()) 0000000076834c92 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788869488.875707:0:3615:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000057e52e16): req@0000000099f250c0 x1875765554589184/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869488.875729:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003656cf47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554588672:0@lo:38: 00000100:00100000:3.0:1788869488.875864:0:7792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869488.875902:0:7792:0:(client.c:2702:ptlrpc_set_wait()) set 0000000057e52e16 going to sleep for 11 seconds 00000100:00100000:2.0:1788869488.875948:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554589184 00000100:00100000:2.0:1788869488.875955:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554589184 00000100:00100000:2.0:1788869488.875998:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788869488.876006:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c50f244 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7792:x1875765554589184:12345-0@lo:1000: 00000100:00100000:2.0:1788869488.876075:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c50f244 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7792:x1875765554589184:12345-0@lo:1000: Request processed in 70us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869488.876082:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788869488.876145:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c827e510 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554589696:0@lo:41: 00000100:00100000:0.0:1788869488.876178:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869488.876316:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554589696 00000100:00100000:3.0:1788869488.876321:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554589696 00000100:00100000:3.0:1788869488.876352:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869488.876359:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003c3f262 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1875765554589696:12345-0@lo:41: 00000004:00000024:3.0:1788869488.876379:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788869488.876394:0:7792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099f250c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7792:1875765554589184:0@lo:1000: 00000100:00100000:3.0:1788869488.876411:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003c3f262 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1875765554589696:12345-0@lo:41: Request processed in 54us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869488.876417:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000040:01000000:1.0:1788869488.876422:0:7792:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788869488.876453:0:7792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009ae0a131 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7792:1875765554589824:0@lo:1000: 00000100:00100000:1.0:1788869488.876483:0:7792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869488.876505:0:7792:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ac1599b5 going to sleep for 11 seconds 00000100:00100000:0.0:1788869488.876515:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c827e510 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554589696:0@lo:41: 00000100:00100000:0.0:1788869488.876531:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554589824 00000100:00100000:0.0:1788869488.876534:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554589824 00000100:00100000:0.0:1788869488.876553:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788869488.876556:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000244ea72 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7792:x1875765554589824:12345-0@lo:1000: 00000100:00100000:0.0:1788869488.876635:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000244ea72 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7792:x1875765554589824:12345-0@lo:1000: Request processed in 78us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869488.876642:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788869488.876644:0:7792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009ae0a131 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7792:1875765554589824:0@lo:1000: 00000100:00100000:1.0:1788869488.876678:0:7792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009ae0a131 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7792:1875765554589952:0@lo:700: 00000100:00100000:1.0:1788869488.876701:0:7792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869488.876752:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554589952 00000100:00100000:2.0:1788869488.876757:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554589952 00000100:00100000:3.0:1788869488.876865:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869488.876872:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd6c4620 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7792:x1875765554589952:12345-0@lo:700: 00000100:00100000:2.0:1788869488.876913:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:2.0:1788869488.876920:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00000100:00100000:1.0:1788869488.877067:0:7792:0:(client.c:2702:ptlrpc_set_wait()) set 0000000029bebc93 going to sleep for 11 seconds 00000100:00100000:3.0:1788869488.877077:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd6c4620 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7792:x1875765554589952:12345-0@lo:700: Request processed in 206us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869488.877078:0:7792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009ae0a131 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7792:1875765554589952:0@lo:700: 00000100:00100000:3.0:1788869488.877084:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869488.877335:0:7792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000461ac226 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7792:1875765554590080:0@lo:1000: 00000100:00100000:0.0:1788869488.877361:0:7792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869488.877379:0:7792:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f8102cf4 going to sleep for 11 seconds 00000100:00100000:3.0:1788869488.877424:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554590080 00000100:00100000:3.0:1788869488.877427:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554590080 00000100:00100000:3.0:1788869488.877448:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869488.877454:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f81b8c7e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7792:x1875765554590080:12345-0@lo:1000: 00000100:00100000:3.0:1788869488.877532:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f81b8c7e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7792:x1875765554590080:12345-0@lo:1000: Request processed in 79us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869488.877536:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788869488.877660:0:7792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000461ac226 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7792:1875765554590080:0@lo:1000: 00000004:00080000:0.0:1788869488.877688:0:7792:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000029bebc93 with version 0 00000020:00100000:0.0:1788869488.877698:0:7792:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788869488.877701:0:7792:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000461ac226 x1875765554590336/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788869488.877710:0:7792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000461ac226 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7792:1875765554590336:0@lo:1000: 00000100:00100000:0.0:1788869488.877724:0:7792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869488.877770:0:7792:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f8102cf4 going to sleep for 11 seconds 00000100:00100000:3.0:1788869488.877853:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554590336 00000100:00100000:3.0:1788869488.877856:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554590336 00000100:00100000:3.0:1788869488.877876:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788869488.877882:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086d3b5ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7792:x1875765554590336:12345-0@lo:1000: 00000001:00080000:0.0:1788869488.886874:0:7415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1788869488.886886:0:7415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788869488.887032:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086d3b5ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7792:x1875765554590336:12345-0@lo:1000: Request processed in 9149us (9304us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788869488.887043:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:0.0:1788869488.887143:0:7792:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788869488.887148:0:7792:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788869488.887162:0:7792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000461ac226 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7792:1875765554590336:0@lo:1000: 00000100:00100000:0.0:1788869488.887245:0:7792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000461ac226 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7792:1875765554590464:0@lo:1000: 00000100:00100000:0.0:1788869488.887309:0:7792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869488.887332:0:7792:0:(client.c:2702:ptlrpc_set_wait()) set 000000003000cde2 going to sleep for 11 seconds 00000100:00100000:3.0:1788869488.887468:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554590464 00000100:00100000:3.0:1788869488.887475:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554590464 00000100:00100000:3.0:1788869488.887516:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788869488.887524:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004da65600 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7792:x1875765554590464:12345-0@lo:1000: 00000100:00100000:3.0:1788869488.887606:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004da65600 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7792:x1875765554590464:12345-0@lo:1000: Request processed in 83us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869488.887613:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788869488.887720:0:7792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000461ac226 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7792:1875765554590464:0@lo:1000: 00000040:00080000:0.0:1788869488.887734:0:7792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788869488.887762:0:7792:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000f8102cf4 with version 1 00000004:00080000:3.0:1788869488.887872:0:7789:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000eb058335 version 1 rpc_version 1 00000020:00100000:3.0:1788869488.887888:0:7789:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788869488.887894:0:7789:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000000c314522 x1875765554590720/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869488.887907:0:7789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000c314522 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7789:1875765554590720:0@lo:1000: 00000100:00100000:3.0:1788869488.887944:0:7789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869488.888043:0:7789:0:(client.c:2702:ptlrpc_set_wait()) set 000000000d6afa79 going to sleep for 11 seconds 00000100:00100000:1.0:1788869488.888617:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554590720 00000100:00100000:1.0:1788869488.888623:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554590720 00000100:00100000:1.0:1788869488.888650:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788869488.888656:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070d47225 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7789:x1875765554590720:12345-0@lo:1000: 00000040:00080000:0.0:1788869488.891752:0:7792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000001:00080000:3.0:1788869488.892077:0:7415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1788869488.892288:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070d47225 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7789:x1875765554590720:12345-0@lo:1000: Request processed in 3629us (4340us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788869488.892300:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1788869488.892908:0:7789:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000004:00080000:0.0:1788869488.892910:0:7792:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1788869488.892913:0:7789:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000004:00080000:0.0:1788869488.892914:0:7792:0:(lod_dev.c:546:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:3.0:1788869488.892928:0:7789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000c314522 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7789:1875765554590720:0@lo:1000: 00010000:00010000:1.0:1788869489.560587:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788869490.262985:0:7843:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788869490.263109:0:7843:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788869490.584514:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869490.584948:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000c314522 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554590848:0@lo:41: 00000100:00100000:0.0:1788869490.585020:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869490.585155:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554590848 00000100:00100000:3.0:1788869490.585163:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554590848 00000100:00100000:3.0:1788869490.585217:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788869490.585227:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000461ac226 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554590848:12345-0@lo:41: 00000004:00000024:3.0:1788869490.585282:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788869490.585332:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000461ac226 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554590848:12345-0@lo:41: Request processed in 106us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869490.585339:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788869490.585511:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000c314522 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554590848:0@lo:41: 00000020:00000080:2.0:1788869490.905541:0:7891:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb672b020 20000000:00000080:2.0:1788869490.905555:0:7891:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99ffb8a5b800 uarg=0000000000000000 20000000:01000000:2.0:1788869490.905597:0:7891:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788869490.905602:0:7891:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788869490.905606:0:7891:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788869490.905728:0:7891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788869490.905738:0:7891:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788869490.908377:0:7891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869490.909027:0:7891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788869490.909135:0:7891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788869490.909156:0:7891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788869490.909174:0:7891:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788869490.909191:0:7891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000098b72576/0xbead52e175fc2941 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869490.909209:0:7891:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000df91d8e/0xbead52e175fc27c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc27b9 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869490.909217:0:7891:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000016328a5e/0xbead52e175fc28ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc28a7 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869490.909225:0:7891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000098b72576/0xbead52e175fc2941 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869490.909358:0:7891:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000016328a5e/0xbead52e175fc28ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc28a7 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869490.909372:0:7891:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000016328a5e/0xbead52e175fc28ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc28a7 expref: 17 pid: 6478 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869490.909386:0:7891:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001f390e59 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7891:1875765554590976:0@lo:104: 00000100:00100000:2.0:1788869490.909448:0:7891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869490.909570:0:7891:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000df91d8e/0xbead52e175fc27c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc27b9 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869490.909578:0:7891:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000df91d8e/0xbead52e175fc27c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc27b9 expref: 17 pid: 6478 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869490.909596:0:7891:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000476a3a35 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7891:1875765554591104:0@lo:104: 00000100:00100000:2.0:1788869490.909615:0:7891:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d75a51b0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869490.909810:0:6468:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788869490.909829:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869490.909885:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554590976 00000100:00100000:1.0:1788869490.909892:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554590976 00000100:00100000:2.0:1788869490.909943:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554591104 00000100:00100000:2.0:1788869490.909947:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554591104 00000100:00100000:2.0:1788869490.909969:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869490.909975:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032025c6f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+4:7891:x1875765554590976:12345-0@lo:104: 00010000:00010000:2.0:1788869490.909989:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: 00000000e336a97e/0xbead52e175fc28a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc28ae expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869490.910068:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788869490.910074:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032025c6f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+4:7891:x1875765554590976:12345-0@lo:104: Request processed in 99us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869490.910081:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869490.910134:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869490.910140:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ae0a131 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+3:7891:x1875765554591104:12345-0@lo:104: 00010000:00010000:2.0:1788869490.910147:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: 000000006c3dfd5c/0xbead52e175fc27b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc27c0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869490.910179:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788869490.910183:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ae0a131 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+3:7891:x1875765554591104:12345-0@lo:104: Request processed in 45us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869490.910189:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788869490.910233:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869490.910239:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: 00000000e336a97e/0xbead52e175fc28a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc28ae expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869490.910246:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e336a97e already unused, calling callback (00000000cb5a5c96) 10000000:00010000:3.0:1788869490.910249:0:7425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: 00000000e336a97e/0xbead52e175fc28a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc28ae expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869490.910283:0:7425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: 00000000e336a97e/0xbead52e175fc28a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc28ae expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869490.910290:0:7425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: 00000000e336a97e/0xbead52e175fc28a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc28ae expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869490.910295:0:7425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788869490.910326:0:7425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: 00000000e336a97e/0xbead52e175fc28a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc28ae expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869490.910339:0:7425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869490.910357:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: 00000000e336a97e/0xbead52e175fc28a7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc28ae expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869490.910363:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: 00000000e336a97e/0xbead52e175fc28a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc28ae expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869490.910376:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869490.910378:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: 000000006c3dfd5c/0xbead52e175fc27b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc27c0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869490.910383:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006c3dfd5c already unused, calling callback (00000000cb5a5c96) 10000000:00010000:3.0:1788869490.910385:0:7425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: 000000006c3dfd5c/0xbead52e175fc27b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc27c0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869490.910391:0:7425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: 000000006c3dfd5c/0xbead52e175fc27b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc27c0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869490.910397:0:7425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: 000000006c3dfd5c/0xbead52e175fc27b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc27c0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869490.910402:0:7425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788869490.910414:0:7425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: 000000006c3dfd5c/0xbead52e175fc27b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc27c0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869490.910420:0:7425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869490.910425:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: 000000006c3dfd5c/0xbead52e175fc27b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc27c0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869490.910430:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: 000000006c3dfd5c/0xbead52e175fc27b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc27c0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869490.910450:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869490.910451:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869490.910453:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869490.910465:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000056965570 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554591232:0@lo:103: 00000100:00100000:3.0:1788869490.910494:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869490.910515:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869490.910520:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000083268b13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554591360:0@lo:103: 00000100:00100000:3.0:1788869490.910538:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869490.910577:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554591232 00000100:00100000:3.0:1788869490.910580:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554591232 00010000:00010000:3.0:1788869490.910597:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000016328a5e/0xbead52e175fc28ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc28a7 expref: 18 pid: 6478 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869490.910614:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554591360 00000100:00100000:3.0:1788869490.910616:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554591360 00010000:00010000:3.0:1788869490.910634:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000df91d8e/0xbead52e175fc27c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc27b9 expref: 19 pid: 6478 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869490.910644:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788869490.910649:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e99d99c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+19:3616:x1875765554591232:12345-0@lo:103: 00010000:00010000:3.0:1788869490.910658:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869490.910662:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000016328a5e/0xbead52e175fc28ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc28a7 expref: 19 pid: 6478 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869490.910670:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000016328a5e/0xbead52e175fc28ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc28a7 expref: 19 pid: 6478 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869490.910684:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869490.910714:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e99d99c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+19:3616:x1875765554591232:12345-0@lo:103: Request processed in 65us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869490.910720:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788869490.910732:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788869490.910737:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001964b904 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+18:3616:x1875765554591360:12345-0@lo:103: 00010000:00010000:3.0:1788869490.910744:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869490.910747:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000df91d8e/0xbead52e175fc27c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc27b9 expref: 18 pid: 6478 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869490.910768:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000df91d8e/0xbead52e175fc27c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc27b9 expref: 18 pid: 6478 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869490.910779:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000098b72576/0xbead52e175fc2941 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869490.910787:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000098b72576/0xbead52e175fc2941 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869490.910799:0:6469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000098b72576/0xbead52e175fc2941 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869490.910805:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000098b72576/0xbead52e175fc2941 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869490.910811:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000098b72576/0xbead52e175fc2941 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869490.910816:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000098b72576/0xbead52e175fc2941 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869490.910821:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000098b72576 already unused, calling callback (000000000b2a4490) 00010000:00010000:3.0:1788869490.910829:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000098b72576/0xbead52e175fc2941 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869490.910836:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000098b72576/0xbead52e175fc2941 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869490.910843:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000098b72576/0xbead52e175fc2941 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869490.910852:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869490.910875:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001964b904 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+18:3616:x1875765554591360:12345-0@lo:103: Request processed in 137us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869490.910881:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788869490.910918:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000083268b13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554591360:0@lo:103: 00000100:00100000:3.0:1788869490.910926:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000056965570 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554591232:0@lo:103: 00010000:00010000:3.0:1788869490.910958:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869490.911542:0:7891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000016328a5e/0xbead52e175fc28ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc28a7 expref: 17 pid: 6478 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869490.911567:0:7891:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001f390e59 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7891:1875765554590976:0@lo:104: 00010000:00010000:0.0:1788869490.911577:0:7891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000df91d8e/0xbead52e175fc27c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc27b9 expref: 16 pid: 6478 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869490.911584:0:7891:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000476a3a35 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7891:1875765554591104:0@lo:104: 00010000:00010000:0.0:1788869490.911600:0:7891:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000098b72576/0xbead52e175fc2941 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869490.911720:0:7891:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000098b72576/0xbead52e175fc2941 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869490.911730:0:7891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000098b72576/0xbead52e175fc2941 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869490.911735:0:7891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000098b72576/0xbead52e175fc2941 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869491.611947:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869492.632388:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869493.664333:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869494.172537:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005773e045 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554591616:0@lo:400: 00000100:00100000:2.0:1788869494.172606:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869494.172670:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788869494.172676:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007eada3c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554591488:0@lo:400: 00000100:00100000:2.0:1788869494.172720:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869494.172742:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003604062c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554592000:0@lo:400: 00000100:00100000:2.0:1788869494.172767:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869494.172789:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000938c8ce2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554591744:0@lo:400: 00000100:00100000:2.0:1788869494.172808:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869494.172823:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869494.172827:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008dea37cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554591872:0@lo:400: 00000100:00100000:2.0:1788869494.172844:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869494.172871:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554591616 00000100:00100000:2.0:1788869494.172878:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554591616 00000100:00100000:2.0:1788869494.172912:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554591872 00000100:00100000:2.0:1788869494.172914:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554591872 00000100:00100000:2.0:1788869494.172926:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788869494.172932:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001024d007 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554591616:12345-0@lo:400: 00000100:00100000:2.0:1788869494.172973:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001024d007 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554591616:12345-0@lo:400: Request processed in 41us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869494.172979:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788869494.172993:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869494.172997:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f390e59 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554591872:12345-0@lo:400: 00000100:00100000:2.0:1788869494.173019:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f390e59 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554591872:12345-0@lo:400: Request processed in 22us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869494.173024:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869494.173037:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554591488 00000100:00100000:2.0:1788869494.173040:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554591488 00000100:00100000:2.0:1788869494.173058:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788869494.173064:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9991821 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+16:3619:x1875765554591488:12345-0@lo:400: 00000100:00100000:2.0:1788869494.173086:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9991821 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+16:3619:x1875765554591488:12345-0@lo:400: Request processed in 24us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869494.173098:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788869494.173133:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554592000 00000100:00100000:2.0:1788869494.173136:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554592000 00000100:00100000:2.0:1788869494.173155:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554591744 00000100:00100000:2.0:1788869494.173158:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554591744 00000100:00100000:2.0:1788869494.173167:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788869494.173171:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebebca19 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554592000:12345-0@lo:400: 00000100:00100000:2.0:1788869494.173506:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebebca19 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554592000:12345-0@lo:400: Request processed in 333us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869494.173513:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788869494.173525:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788869494.173530:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000476a3a35 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554591744:12345-0@lo:400: 00000100:00100000:2.0:1788869494.173554:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000476a3a35 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554591744:12345-0@lo:400: Request processed in 25us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869494.173559:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788869494.173597:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008dea37cf x1875765554591872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869494.173610:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008dea37cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554591872:0@lo:400: 00000100:00100000:2.0:1788869494.173619:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000938c8ce2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554591744:0@lo:400: 00000100:00100000:2.0:1788869494.173841:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007eada3c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554591488:0@lo:400: 00000100:00100000:2.0:1788869494.173850:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003604062c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554592000:0@lo:400: 00010000:00080000:2.0:1788869494.173858:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000005773e045 x1875765554591616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869494.173866:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005773e045 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554591616:0@lo:400: 00000100:00100000:1.0:1788869494.187403:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869494.187428:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000317fd664 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554592128:0@lo:41: 00000100:00100000:1.0:1788869494.187511:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869494.187561:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554592128 00000100:00100000:1.0:1788869494.187570:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554592128 00000100:00100000:1.0:1788869494.187615:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788869494.187622:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062c35b2e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554592128:12345-0@lo:41: 00000004:00000024:1.0:1788869494.187657:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788869494.187720:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062c35b2e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554592128:12345-0@lo:41: Request processed in 98us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869494.187727:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788869494.187774:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000317fd664 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554592128:0@lo:41: 00010000:00010000:3.0:1788869494.681720:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788869494.872352:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788869494.872359:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ff89980800 from 1 10000000:01000000:2.0:1788869494.872364:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788869494.872430:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 00000000ada184bb/0xbead52e175fc2948 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869494.872442:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 00000000ada184bb/0xbead52e175fc2948 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869494.872452:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 00000000ada184bb/0xbead52e175fc2948 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869494.872477:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005773e045 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554592256:0@lo:101: 00000100:00100000:2.0:1788869494.872543:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869494.872601:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d19cdf9f going to sleep for 11 seconds 00000100:00100000:0.0:1788869494.872683:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554592256 00000100:00100000:0.0:1788869494.872691:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554592256 00000100:00100000:0.0:1788869494.872744:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788869494.872752:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a718da37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:6481:x1875765554592256:12345-0@lo:101: 00010000:00010000:0.0:1788869494.872765:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869494.872777:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004f67f551/0xbead52e175fc294f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2948 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869494.872798:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004f67f551/0xbead52e175fc294f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2948 expref: 17 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869494.872806:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004f67f551/0xbead52e175fc294f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2948 expref: 17 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869494.872813:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004f67f551, rc 0) 00000100:00100000:0.0:1788869494.872855:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a718da37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554592256:12345-0@lo:101: Request processed in 105us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869494.872862:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788869494.872908:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005773e045 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554592256:0@lo:101: 00010000:00010000:0.0:1788869494.872936:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 00000000ada184bb/0xbead52e175fc2948 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc294f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869494.872945:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 00000000ada184bb/0xbead52e175fc2948 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc294f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869494.873002:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004205a81a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554592384:0@lo:501: 00000100:00100000:0.0:1788869494.873026:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869494.873041:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c92f3055 going to sleep for 11 seconds 00000100:00100000:0.0:1788869494.873054:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554592384 00000100:00100000:0.0:1788869494.873057:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554592384 00000100:00100000:0.0:1788869494.873079:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788869494.873085:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000500e842e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554592384:12345-0@lo:501: 00000100:00100000:0.0:1788869494.873198:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000500e842e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554592384:12345-0@lo:501: Request processed in 114us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869494.873205:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788869494.873233:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004205a81a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554592384:0@lo:501: 00000100:00100000:0.0:1788869494.873284:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004205a81a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554592512:0@lo:503: 00000100:00100000:0.0:1788869494.873330:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869494.873341:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c92f3055 going to sleep for 11 seconds 00000100:00100000:0.0:1788869494.873351:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554592512 00000100:00100000:0.0:1788869494.873354:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554592512 00000100:00100000:0.0:1788869494.873373:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788869494.873377:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013ea8f60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554592512:12345-0@lo:503: 00000100:00100000:0.0:1788869494.873447:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013ea8f60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554592512:12345-0@lo:503: Request processed in 69us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869494.873453:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788869494.873493:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004205a81a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554592512:0@lo:503: 00000100:00100000:0.0:1788869494.873706:0:8120:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004205a81a pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8120:1875765554592640:0@lo:502: 00000100:00100000:0.0:1788869494.873740:0:8120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869494.873757:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554592640 00000100:00100000:0.0:1788869494.873760:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554592640 00000100:00100000:0.0:1788869494.873780:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788869494.873785:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9d13b84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:8120:x1875765554592640:12345-0@lo:502: 00000100:00100000:0.0:1788869494.873847:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9d13b84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:8120:x1875765554592640:12345-0@lo:502: Request processed in 61us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869494.873853:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788869494.873879:0:8120:0:(client.c:2702:ptlrpc_set_wait()) set 00000000256c9d3e going to sleep for 11 seconds 00000100:00100000:0.0:1788869494.873890:0:8120:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004205a81a pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8120:1875765554592640:0@lo:502: 00000020:01000000:0.0:1788869494.873908:0:8120:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869494.873917:0:8120:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869494.873919:0:8120:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788869494.873926:0:8120:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ff89980800 00000020:00000080:0.0:1788869494.873928:0:8120:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788869494.873964:0:8120:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8120:1875765554592768:0@lo:502: 00000100:00100000:0.0:1788869494.873994:0:8120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869494.874012:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554592768 00000100:00100000:0.0:1788869494.874016:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554592768 00000100:00100000:0.0:1788869494.874036:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788869494.874042:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:8120:x1875765554592768:12345-0@lo:502: 00000100:00100000:0.0:1788869494.874094:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:8120:x1875765554592768:12345-0@lo:502: Request processed in 52us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869494.874100:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788869494.874138:0:8120:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89fa3240 going to sleep for 11 seconds 00000100:00100000:0.0:1788869494.874169:0:8120:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8120:1875765554592768:0@lo:502: 00000020:01000000:0.0:1788869494.874186:0:8120:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869494.874190:0:8120:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869494.874192:0:8120:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788869494.874195:0:8120:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788869494.874240:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788869494.874273:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788869494.874282:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81535400/0xbead52e175fc2948 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc294f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869494.874292:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ff81535400/0xbead52e175fc2948 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc294f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869494.874300:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788869494.874302:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ff8b15e800 from 1 10000000:01000000:0.0:1788869494.874305:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788869494.874323:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff80031a00/0xbead52e175fc2956 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869494.874330:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ff80031a00/0xbead52e175fc2956 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869494.874338:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ff80031a00/0xbead52e175fc2956 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869494.874350:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554592896:0@lo:101: 00000100:00100000:0.0:1788869494.874375:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869494.874389:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89fa3240 going to sleep for 11 seconds 00000100:00100000:0.0:1788869494.874400:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554592896 00000100:00100000:0.0:1788869494.874403:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554592896 00000100:00100000:0.0:1788869494.874423:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788869494.874436:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554592896:12345-0@lo:101: 00010000:00010000:0.0:1788869494.874443:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869494.874454:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff80031200/0xbead52e175fc295d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2956 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869494.874470:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff80031200/0xbead52e175fc295d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2956 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869494.874480:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff80031200/0xbead52e175fc295d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2956 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869494.874487:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80031200, rc 0) 00000100:00100000:0.0:1788869494.874514:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554592896:12345-0@lo:101: Request processed in 79us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869494.874520:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788869494.874550:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554592896:0@lo:101: 00010000:00010000:0.0:1788869494.874561:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ff80031a00/0xbead52e175fc2956 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc295d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869494.874569:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ff80031a00/0xbead52e175fc2956 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc295d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869494.874606:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554593024:0@lo:501: 00000100:00100000:0.0:1788869494.874630:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869494.874642:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89fa3240 going to sleep for 11 seconds 00000100:00100000:0.0:1788869494.874652:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554593024 00000100:00100000:0.0:1788869494.874655:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554593024 00000100:00100000:0.0:1788869494.874688:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788869494.874696:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554593024:12345-0@lo:501: 00000100:00100000:0.0:1788869494.874768:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554593024:12345-0@lo:501: Request processed in 74us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869494.874775:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788869494.874801:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554593024:0@lo:501: 00000100:00100000:0.0:1788869494.874823:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554593152:0@lo:503: 00000100:00100000:0.0:1788869494.874853:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869494.874865:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae6bd900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869494.874875:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554593152 00000100:00100000:0.0:1788869494.874878:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554593152 00000100:00100000:0.0:1788869494.874897:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788869494.874902:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554593152:12345-0@lo:503: 00000100:00100000:0.0:1788869494.874957:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554593152:12345-0@lo:503: Request processed in 55us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869494.874963:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788869494.874996:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554593152:0@lo:503: 00000100:00100000:0.0:1788869494.875198:0:8121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8121:1875765554593280:0@lo:502: 00000100:00100000:0.0:1788869494.875228:0:8121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869494.875245:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554593280 00000100:00100000:0.0:1788869494.875249:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554593280 00000100:00100000:0.0:1788869494.875287:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788869494.875293:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:8121:x1875765554593280:12345-0@lo:502: 00000100:00100000:0.0:1788869494.875348:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:8121:x1875765554593280:12345-0@lo:502: Request processed in 54us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869494.875354:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788869494.875378:0:8121:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae6bdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869494.875394:0:8121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8121:1875765554593280:0@lo:502: 00000020:01000000:0.0:1788869494.875409:0:8121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869494.875416:0:8121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869494.875418:0:8121:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788869494.875423:0:8121:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ff8b15e800 00000020:00000080:0.0:1788869494.875425:0:8121:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788869494.875442:0:8121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8121:1875765554593408:0@lo:502: 00000100:00100000:0.0:1788869494.875469:0:8121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869494.875486:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554593408 00000100:00100000:0.0:1788869494.875490:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554593408 00000100:00100000:0.0:1788869494.875509:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788869494.875514:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:8121:x1875765554593408:12345-0@lo:502: 00000100:00100000:0.0:1788869494.875563:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:8121:x1875765554593408:12345-0@lo:502: Request processed in 48us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869494.875569:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788869494.875593:0:8121:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae6bdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869494.875603:0:8121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8121:1875765554593408:0@lo:502: 00000020:01000000:0.0:1788869494.875617:0:8121:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869494.875621:0:8121:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869494.875622:0:8121:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788869494.875626:0:8121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788869494.875658:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788869494.891983:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788869494.892000:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff80031a00/0xbead52e175fc2956 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc295d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869494.892015:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ff80031a00/0xbead52e175fc2956 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc295d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869495.704374:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869495.704733:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554593536:0@lo:41: 00000100:00100000:2.0:1788869495.704799:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869495.704896:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554593536 00000100:00100000:3.0:1788869495.704903:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554593536 00000100:00100000:3.0:1788869495.704963:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788869495.704973:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554593536:12345-0@lo:41: 00000004:00000024:3.0:1788869495.705005:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788869495.705048:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554593536:12345-0@lo:41: Request processed in 76us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869495.705054:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788869495.705132:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554593536:0@lo:41: 00010000:00010000:0.0:1788869496.728722:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869497.753334:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869498.776549:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869499.289487:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554594176:0@lo:400: 00000100:00100000:2.0:1788869499.289596:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869499.289652:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788869499.289658:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554593792:0@lo:400: 00000100:00100000:3.0:1788869499.289673:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554594048:0@lo:400: 00000100:00100000:2.0:1788869499.289687:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869499.289708:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554593664:0@lo:41: 00000100:00100000:3.0:1788869499.289720:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869499.289741:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869499.289747:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554593920:0@lo:400: 00000100:00100000:3.0:1788869499.289769:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869499.289861:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869499.289887:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554594304:0@lo:400: 00000100:00100000:2.0:1788869499.289913:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869499.289943:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554594176 00000100:00100000:2.0:1788869499.289949:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554594176 00000100:00100000:2.0:1788869499.289985:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554593920 00000100:00100000:2.0:1788869499.289988:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554593920 00000100:00100000:2.0:1788869499.290001:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869499.290009:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554594176:12345-0@lo:400: 00000100:00100000:2.0:1788869499.290055:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554594176:12345-0@lo:400: Request processed in 47us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869499.290062:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869499.290078:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869499.290281:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554593920:12345-0@lo:400: 00000100:00100000:2.0:1788869499.290320:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554593920:12345-0@lo:400: Request processed in 43us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869499.290327:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869499.290348:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554594048 00000100:00100000:2.0:1788869499.290351:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554594048 00000100:00100000:2.0:1788869499.290367:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554593664 00000100:00100000:2.0:1788869499.290370:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554593664 00000100:00100000:2.0:1788869499.290378:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554594304 00000100:00100000:2.0:1788869499.290380:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554594304 00000100:00100000:2.0:1788869499.290391:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788869499.290396:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554594048:12345-0@lo:400: 00000100:00100000:2.0:1788869499.290428:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554594048:12345-0@lo:400: Request processed in 31us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869499.290434:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788869499.290451:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788869499.290457:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3616:x1875765554593664:12345-0@lo:41: 00000004:00000024:2.0:1788869499.290487:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788869499.290490:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554593792 00000100:00100000:0.0:1788869499.290494:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554593792 00000100:00100000:2.0:1788869499.290517:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3616:x1875765554593664:12345-0@lo:41: Request processed in 61us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869499.290520:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788869499.290524:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788869499.290526:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:3616:x1875765554593792:12345-0@lo:400: 00000100:00100000:2.0:1788869499.290534:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788869499.290539:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554594304:12345-0@lo:400: 00000100:00100000:0.0:1788869499.290580:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:3616:x1875765554593792:12345-0@lo:400: Request processed in 46us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869499.290587:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788869499.291717:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554594304:12345-0@lo:400: Request processed in 1173us (1798us total) trans 0 rc 0/0 00010000:00080000:3.0:1788869499.291938:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ff84be6a00 x1875765554593920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869499.291952:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554593920:0@lo:400: 00000100:00100000:3.0:1788869499.291965:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554594048:0@lo:400: 00000100:00100000:2.0:1788869499.292656:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788869499.292715:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554593792:0@lo:400: 00000100:00100000:2.0:1788869499.292920:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554593664:0@lo:41: 00000100:00100000:2.0:1788869499.292932:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554594304:0@lo:400: 00010000:00080000:2.0:1788869499.292946:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ff84be6d80 x1875765554594176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869499.292955:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554594176:0@lo:400: 00010000:00010000:0.0:1788869499.801536:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788869500.545938:0:8392:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788869500.545943:0:8392:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788869500.545944:0:8392:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788869500.547222:0:8392:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99ffc10cf800 00000020:01000004:3.0:1788869500.547240:0:8392:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788869500.547279:0:8392:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788869500.547292:0:8392:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99ffc10f0000) 00000020:00000080:3.0:1788869500.547311:0:8392:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788869500.646926:0:8392:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788869500.646989:0:8392:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1788869500.711006:0:8392:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788869500.717756:0:8392:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788869500.717770:0:8392:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788869500.717783:0:8392:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbead52e175fc296b 00000020:01000004:0.0:1788869500.717790:0:8392:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788869500.717810:0:8392:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.130@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788869500.717814:0:8392:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788869500.717819:0:8392:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788869500.717823:0:8392:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788869500.717836:0:8392:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99ff955cb380) 00000020:00000080:0.0:1788869500.717845:0:8392:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1788869500.723185:0:8392:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788869500.724711:0:8392:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788869500.724721:0:8392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788869500.728478:0:8392:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788869500.728489:0:8392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788869500.728999:0:8392:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788869500.729006:0:8392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788869500.756023:0:8392:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869500.756212:0:8392:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788869500.756219:0:8392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788869500.768727:0:8392:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788869500.768740:0:8392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788869500.824710:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554594432:0@lo:41: 00000100:00100000:2.0:1788869500.824780:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869500.824896:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869500.824945:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554594432 00000100:00100000:0.0:1788869500.824952:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554594432 00000100:00100000:0.0:1788869500.825008:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788869500.825017:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554594432:12345-0@lo:41: 00000004:00000024:0.0:1788869500.825061:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1788869500.843427:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554594432:12345-0@lo:41: Request processed in 18401us (18636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869500.843443:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788869500.854445:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554594432:0@lo:41: 00000100:00100000:2.0:1788869500.856891:0:8392:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869500.857860:0:8392:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788869500.857868:0:8392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788869500.864391:0:8392:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788869500.864407:0:8392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788869500.872642:0:8392:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788869500.872663:0:8392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788869500.876848:0:8392:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788869500.877025:0:8392:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788869500.877035:0:8392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788869500.879610:0:8392:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788869500.879620:0:8392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788869501.016243:0:8392:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869501.016462:0:8392:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788869501.016470:0:8392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788869501.018222:0:8392:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788869501.018233:0:8392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788869501.019003:0:8392:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788869501.019989:0:8392:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788869501.020004:0:8392:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788869501.073821:0:8392:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788869501.073869:0:8392:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.130@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788869501.073877:0:8392:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788869501.073879:0:8392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788869501.073880:0:8392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869501.073882:0:8392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869501.073883:0:8392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869501.073884:0:8392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869501.073886:0:8392:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869501.073887:0:8392:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788869501.073888:0:8392:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788869501.073890:0:8392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869501.073891:0:8392:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788869501.073895:0:8392:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788869501.073897:0:8392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788869501.073899:0:8392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788869501.073900:0:8392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869501.073901:0:8392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869501.073902:0:8392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869501.073903:0:8392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869501.073904:0:8392:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869501.073904:0:8392:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788869501.073905:0:8392:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788869501.073906:0:8392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869501.073907:0:8392:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788869501.073934:0:8392:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788869501.073953:0:8392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554594560:0@lo:253: 00000100:00100000:1.0:1788869501.074815:0:8392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869501.074913:0:8392:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff83977000 going to sleep for 11 seconds 00000100:00100000:2.0:1788869501.076638:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554594560 00000100:00100000:2.0:1788869501.076650:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554594560 00000100:00100000:2.0:1788869501.076751:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788869501.076763:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+18:8392:x1875765554594560:12345-0@lo:253: 20000000:01000000:2.0:1788869501.076801:0:6479:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788869501.076805:0:6479:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788869501.076810:0:6479:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788869501.076814:0:6479:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788869501.080471:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869501.081835:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788869501.081865:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788869501.081890:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788869501.081898:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788869501.081912:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788869501.081950:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788869501.083240:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788869501.083971:0:6479:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.130@tcp 20000000:01000000:2.0:1788869501.083974:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.130@tcp (null) (null) (null) 00000040:00080000:2.0:1788869501.084003:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788869501.084010:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788869501.084783:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788869501.084797:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.130@tcp (null) (null) 00000040:00080000:2.0:1788869501.084815:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788869501.084823:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788869501.084834:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788869501.084850:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788869501.084981:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1788869501.084996:0:6479:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.130@tcp 20000000:01000000:2.0:1788869501.084998:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.130@tcp (null) (null) (null) 00000040:00080000:2.0:1788869501.085013:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1788869501.085403:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788869501.085428:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1788869501.085435:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.201.130@tcp (null) (null) 00000040:00080000:2.0:1788869501.085447:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1788869501.085453:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788869501.085465:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1788869501.085480:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1788869501.085891:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1788869501.085905:0:6479:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.130@tcp 20000000:01000000:2.0:1788869501.085907:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.130@tcp (null) (null) (null) 00000040:00080000:2.0:1788869501.085921:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1788869501.085927:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788869501.085941:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1788869501.085945:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.130@tcp (null) (null) 00000040:00080000:2.0:1788869501.085978:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1788869501.085985:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788869501.085998:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1788869501.086012:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1788869501.086026:0:6479:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788869501.086028:0:6479:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788869501.086031:0:6479:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788869501.086070:0:6479:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788869501.086072:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788869501.086995:0:8411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788869501.087194:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788869501.087216:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788869501.087230:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788869501.087238:0:6479:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788869501.087240:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788869501.087924:0:8412:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1788869501.087964:0:8412:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1788869501.087982:0:8412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788869501.088601:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788869501.088628:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788869501.088642:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1788869501.088653:0:6479:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788869501.088655:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788869501.089922:0:8413:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1788869501.089955:0:8413:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1788869501.089973:0:8413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1788869501.095995:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1788869501.096048:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1788869501.096065:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1788869501.096077:0:6479:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788869501.096080:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788869501.097732:0:8414:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1788869501.097772:0:8414:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1788869501.097790:0:8414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788869501.098071:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1788869501.098093:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1788869501.098106:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:0.0:1788869501.098120:0:6479:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788869501.098141:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ff80031000/0xbead52e175fc2979 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.098171:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ff80030c00/0xbead52e175fc2845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc283e expref: 18 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.098178:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ff80031e00/0xbead52e175fc28bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc28b5 expref: 18 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.098185:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ff829cfc00/0xbead52e175fc28f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc28ed expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.098191:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ff829ce400/0xbead52e175fc2910 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2909 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.098210:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ff80031400/0xbead52e175fc293a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2933 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.098217:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ff80031000/0xbead52e175fc2979 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.098292:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ff80031400/0xbead52e175fc293a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2933 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.098305:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ff80031400/0xbead52e175fc293a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2933 expref: 18 pid: 6479 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869501.098318:0:6479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4ed500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6479:1875765554594688:0@lo:104: 00000100:00100000:0.0:1788869501.098390:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788869501.098454:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ff829ce400/0xbead52e175fc2910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2909 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.098462:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ff829ce400/0xbead52e175fc2910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2909 expref: 18 pid: 6478 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869501.098470:0:6479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4ef480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6479:1875765554594816:0@lo:104: 00000100:00100000:0.0:1788869501.098493:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788869501.098518:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ff829cfc00/0xbead52e175fc28f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc28ed expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.098525:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ff829cfc00/0xbead52e175fc28f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc28ed expref: 18 pid: 6479 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869501.098543:0:6479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4ec000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6479:1875765554594944:0@lo:104: 00000100:00100000:0.0:1788869501.098572:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788869501.098600:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ff80031e00/0xbead52e175fc28bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc28b5 expref: 18 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.098609:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ff80031e00/0xbead52e175fc28bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc28b5 expref: 18 pid: 6476 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869501.098617:0:6479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6479:1875765554595072:0@lo:104: 00000100:00100000:0.0:1788869501.098639:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788869501.098655:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ff80030c00/0xbead52e175fc2845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc283e expref: 18 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.098662:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ff80030c00/0xbead52e175fc2845 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc283e expref: 18 pid: 6476 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869501.098670:0:6479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6479:1875765554595200:0@lo:104: 00000100:00100000:0.0:1788869501.098688:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869501.098699:0:6479:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89afb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869501.098937:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554594688 00000100:00100000:3.0:1788869501.098944:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554594688 00000100:00100000:3.0:1788869501.098977:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554594816 00000100:00100000:3.0:1788869501.098979:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554594816 00000100:00100000:3.0:1788869501.098988:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554594944 00000100:00100000:3.0:1788869501.098991:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554594944 00000100:00100000:3.0:1788869501.098998:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554595072 00000100:00100000:3.0:1788869501.099001:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554595072 00000100:00100000:3.0:1788869501.099008:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554595200 00000100:00100000:3.0:1788869501.099010:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554595200 00000100:00100000:3.0:1788869501.099036:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788869501.099046:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+7:6479:x1875765554594688:12345-0@lo:104: 00010000:00010000:3.0:1788869501.099060:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc2933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc293a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099121:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788869501.099127:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+7:6479:x1875765554594688:12345-0@lo:104: Request processed in 83us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.099134:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788869501.099165:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869501.099172:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+6:6479:x1875765554594816:12345-0@lo:104: 00010000:00010000:3.0:1788869501.099180:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ff81491200/0xbead52e175fc2909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099223:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788869501.099227:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+6:6479:x1875765554594816:12345-0@lo:104: Request processed in 57us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.099233:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869501.099245:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869501.099266:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+5:6479:x1875765554594944:12345-0@lo:104: 00010000:00010000:3.0:1788869501.099279:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ff81490000/0xbead52e175fc28ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc28f4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099312:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788869501.099316:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+5:6479:x1875765554594944:12345-0@lo:104: Request processed in 66us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.099322:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869501.099344:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869501.099351:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+4:6479:x1875765554595072:12345-0@lo:104: 00010000:00010000:3.0:1788869501.099358:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ff81491400/0xbead52e175fc28b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc28bc expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099382:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788869501.099386:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+4:6479:x1875765554595072:12345-0@lo:104: Request processed in 37us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.099391:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869501.099401:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869501.099405:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+3:6479:x1875765554595200:12345-0@lo:104: 00010000:00010000:3.0:1788869501.099411:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ff81490a00/0xbead52e175fc283e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2845 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099443:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788869501.099447:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+3:6479:x1875765554595200:12345-0@lo:104: Request processed in 42us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.099452:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788869501.099468:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788869501.099473:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc2933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc293a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099479:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fe00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1788869501.099482:0:7425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc2933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc293a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099489:0:7425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc2933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc293a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869501.099496:0:7425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc2933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc293a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869501.099502:0:7425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788869501.099528:0:7425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc2933 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc293a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099547:0:7425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869501.099564:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc2933 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc293a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099571:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc2933 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc293a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099595:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788869501.099598:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ff81491200/0xbead52e175fc2909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099603:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81491200 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1788869501.099606:0:7425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ff81491200/0xbead52e175fc2909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099612:0:7425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ff81491200/0xbead52e175fc2909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869501.099618:0:7425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ff81491200/0xbead52e175fc2909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869501.099623:0:7425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788869501.099636:0:7425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ff81491200/0xbead52e175fc2909 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099641:0:7425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869501.099651:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ff81491200/0xbead52e175fc2909 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099658:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ff81491200/0xbead52e175fc2909 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099668:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788869501.099671:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ff81490000/0xbead52e175fc28ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc28f4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099685:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81490000 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1788869501.099688:0:7425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ff81490000/0xbead52e175fc28ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc28f4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099695:0:7425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ff81490000/0xbead52e175fc28ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc28f4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869501.099701:0:7425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ff81490000/0xbead52e175fc28ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc28f4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869501.099705:0:7425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788869501.099719:0:7425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ff81490000/0xbead52e175fc28ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc28f4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099893:0:7425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869501.099901:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ff81490000/0xbead52e175fc28ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc28f4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099907:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ff81490000/0xbead52e175fc28ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc28f4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099919:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869501.099922:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ff81491400/0xbead52e175fc28b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc28bc expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099927:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81491400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1788869501.099930:0:7425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ff81491400/0xbead52e175fc28b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc28bc expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099945:0:7425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ff81491400/0xbead52e175fc28b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc28bc expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869501.099951:0:7425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ff81491400/0xbead52e175fc28b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc28bc expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869501.099956:0:7425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788869501.099969:0:7425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ff81491400/0xbead52e175fc28b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc28bc expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099975:0:7425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869501.099981:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ff81491400/0xbead52e175fc28b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc28bc expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099987:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ff81491400/0xbead52e175fc28b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc28bc expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.099997:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869501.100000:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ff81490a00/0xbead52e175fc283e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2845 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.100005:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81490a00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1788869501.100007:0:7425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ff81490a00/0xbead52e175fc283e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2845 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.100013:0:7425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ff81490a00/0xbead52e175fc283e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2845 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869501.100018:0:7425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ff81490a00/0xbead52e175fc283e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2845 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869501.100029:0:7425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788869501.100042:0:7425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ff81490a00/0xbead52e175fc283e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2845 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.100048:0:7425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869501.100052:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ff81490a00/0xbead52e175fc283e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2845 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.100058:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ff81490a00/0xbead52e175fc283e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2845 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.100072:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869501.100074:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869501.100076:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869501.100083:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869501.100095:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554595328:0@lo:103: 00000100:00100000:3.0:1788869501.100125:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869501.100146:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554595840:0@lo:103: 00000100:00100000:3.0:1788869501.100434:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869501.100462:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869501.100468:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554595712:0@lo:103: 00000100:00100000:3.0:1788869501.100487:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869501.100513:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554595328 00000100:00100000:3.0:1788869501.100518:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554595328 00010000:00010000:3.0:1788869501.100547:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ff80031400/0xbead52e175fc293a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2933 expref: 19 pid: 6479 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869501.100564:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554595840 00000100:00100000:3.0:1788869501.100573:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554595840 00010000:00010000:3.0:1788869501.100586:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ff80030c00/0xbead52e175fc2845 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc283e expref: 20 pid: 6476 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869501.100598:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554595712 00000100:00100000:3.0:1788869501.100600:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554595712 00010000:00010000:3.0:1788869501.100624:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ff80031e00/0xbead52e175fc28bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc28b5 expref: 21 pid: 6476 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869501.100643:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788869501.100650:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8913100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+21:3619:x1875765554595328:12345-0@lo:103: 00010000:00010000:3.0:1788869501.100663:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869501.100668:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ff80031400/0xbead52e175fc293a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2933 expref: 21 pid: 6479 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.100681:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ff80031400/0xbead52e175fc293a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2933 expref: 21 pid: 6479 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.100697:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869501.100828:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869501.100847:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554595584:0@lo:103: 00000100:00100000:0.0:1788869501.100874:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869501.100887:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869501.100892:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554595456:0@lo:103: 00000100:00100000:0.0:1788869501.100913:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869501.101326:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8913100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+21:3619:x1875765554595328:12345-0@lo:103: Request processed in 676us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.101400:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788869501.101419:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554595584 00000100:00100000:3.0:1788869501.101423:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554595584 00010000:00010000:3.0:1788869501.101438:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ff829cfc00/0xbead52e175fc28f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc28ed expref: 21 pid: 6479 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869501.101450:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554595456 00000100:00100000:3.0:1788869501.101453:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554595456 00010000:00010000:3.0:1788869501.101462:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ff829ce400/0xbead52e175fc2910 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2909 expref: 22 pid: 6478 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869501.101487:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869501.101493:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8910000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+22:3619:x1875765554595840:12345-0@lo:103: 00010000:00010000:3.0:1788869501.101501:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869501.101505:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ff80030c00/0xbead52e175fc2845 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc283e expref: 22 pid: 6476 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.101514:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ff80030c00/0xbead52e175fc2845 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc283e expref: 22 pid: 6476 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.101525:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869501.101562:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8910000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+22:3619:x1875765554595840:12345-0@lo:103: Request processed in 69us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.101568:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869501.101581:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869501.101587:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8911500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+21:3619:x1875765554595712:12345-0@lo:103: 00010000:00010000:3.0:1788869501.101593:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869501.101598:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ff80031e00/0xbead52e175fc28bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc28b5 expref: 21 pid: 6476 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.101605:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ff80031e00/0xbead52e175fc28bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc28b5 expref: 21 pid: 6476 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.101615:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869501.101636:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8911500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+21:3619:x1875765554595712:12345-0@lo:103: Request processed in 50us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.101643:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869501.101655:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869501.101668:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+20:3617:x1875765554595584:12345-0@lo:103: 00010000:00010000:3.0:1788869501.101675:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869501.101680:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ff829cfc00/0xbead52e175fc28f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc28ed expref: 20 pid: 6479 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.101689:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ff829cfc00/0xbead52e175fc28f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc28ed expref: 20 pid: 6479 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.101698:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869501.102023:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+20:3617:x1875765554595584:12345-0@lo:103: Request processed in 354us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.102030:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869501.102043:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869501.102049:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89dad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+19:3617:x1875765554595456:12345-0@lo:103: 00010000:00010000:3.0:1788869501.102058:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869501.102063:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ff829ce400/0xbead52e175fc2910 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2909 expref: 19 pid: 6478 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.102072:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ff829ce400/0xbead52e175fc2910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2909 expref: 19 pid: 6478 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.102084:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ff80031000/0xbead52e175fc2979 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.102092:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff80031000/0xbead52e175fc2979 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.102106:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ff80031000/0xbead52e175fc2979 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.102122:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ff80031000/0xbead52e175fc2979 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.102129:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ff80031000/0xbead52e175fc2979 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.102136:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ff80031000/0xbead52e175fc2979 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.102141:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031000 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869501.102145:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ff80031000/0xbead52e175fc2979 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.102165:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ff80031000/0xbead52e175fc2979 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.102175:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ff80031000/0xbead52e175fc2979 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.102184:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869501.102209:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89dad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+19:3617:x1875765554595456:12345-0@lo:103: Request processed in 160us (1296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.102215:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869501.102301:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554595712:0@lo:103: 00000100:00100000:3.0:1788869501.102312:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554595328:0@lo:103: 00000100:00100000:3.0:1788869501.102318:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554595840:0@lo:103: 00010000:00010000:2.0:1788869501.102470:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff80031400/0xbead52e175fc293a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2933 expref: 18 pid: 6479 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869501.102483:0:6479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4ed500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6479:1875765554594688:0@lo:104: 00010000:00010000:2.0:1788869501.102492:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff829ce400/0xbead52e175fc2910 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2909 expref: 17 pid: 6478 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869501.102500:0:6479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4ef480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6479:1875765554594816:0@lo:104: 00010000:00010000:2.0:1788869501.102508:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff829cfc00/0xbead52e175fc28f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc28ed expref: 16 pid: 6479 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869501.102516:0:6479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4ec000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6479:1875765554594944:0@lo:104: 00010000:00010000:2.0:1788869501.102532:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff80031e00/0xbead52e175fc28bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc28b5 expref: 15 pid: 6476 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869501.102548:0:6479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6479:1875765554595072:0@lo:104: 00010000:00010000:2.0:1788869501.102557:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff80030c00/0xbead52e175fc2845 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc283e expref: 14 pid: 6476 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869501.102565:0:6479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6479:1875765554595200:0@lo:104: 00010000:00010000:2.0:1788869501.102585:0:6479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ff80031000/0xbead52e175fc2979 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.102593:0:6479:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ff80031000/0xbead52e175fc2979 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.102599:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ff80031000/0xbead52e175fc2979 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.102611:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff80031000/0xbead52e175fc2979 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788869501.102628:0:6479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788869501.105515:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554595456:0@lo:103: 00000100:00100000:0.0:1788869501.105550:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554595584:0@lo:103: 00000100:00100000:0.0:1788869501.106827:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+13:8392:x1875765554594560:12345-0@lo:253: Request processed in 30062us (32802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869501.106856:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788869501.107013:0:8392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554594560:0@lo:253: 10000000:01000000:2.0:1788869501.107028:0:8392:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788869501.107031:0:8392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788869501.107033:0:8392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788869501.107034:0:8392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869501.107036:0:8392:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788869501.107037:0:8392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869501.107039:0:8392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869501.107040:0:8392:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869501.107042:0:8392:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788869501.107043:0:8392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869501.107044:0:8392:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788869501.107063:0:8392:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ffc10cf800 from lustre-OST0000 10000000:01000000:2.0:1788869501.107093:0:8392:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788869501.107095:0:8392:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788869501.107103:0:8392:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99ff8b770000 local copy 10000000:01000000:2.0:1788869501.107108:0:8392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788869501.107143:0:8392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81534200/0xbead52e175fc2980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.107155:0:8392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.130@tcp lock: ffff99ff81534200/0xbead52e175fc2980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.107165:0:8392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ff81534200/0xbead52e175fc2980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869501.107183:0:8392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554595968:0@lo:101: 00000100:00100000:2.0:1788869501.107230:0:8392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.107290:0:8392:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd000 going to sleep for 11 seconds 00000100:00100000:0.0:1788869501.107812:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554595968 00000100:00100000:0.0:1788869501.107819:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554595968 00000100:00100000:2.0:1788869501.109369:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788869501.109390:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+13:8392:x1875765554595968:12345-0@lo:101: 00010000:00010000:2.0:1788869501.109407:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869501.109426:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff81534e00/0xbead52e175fc2987 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2980 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.109453:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff81534e00/0xbead52e175fc2987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2980 expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.109466:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff81534e00/0xbead52e175fc2987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2980 expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.109475:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534e00, rc 0) 00000100:00100000:2.0:1788869501.109694:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+14:8392:x1875765554595968:12345-0@lo:101: Request processed in 313us (2463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869501.109701:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788869501.109835:0:8392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554595968:0@lo:101: 00010000:00010000:3.0:1788869501.109872:0:8392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ff81534200/0xbead52e175fc2980 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbead52e175fc2987 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.109881:0:8392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ff81534200/0xbead52e175fc2980 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbead52e175fc2987 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869501.109984:0:8392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8912a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554596096:0@lo:501: 00000100:00100000:3.0:1788869501.110019:0:8392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869501.110052:0:8392:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff85870f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869501.110101:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554596096 00000100:00100000:2.0:1788869501.110108:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554596096 00000100:00100000:2.0:1788869501.110131:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788869501.110138:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+14:8392:x1875765554596096:12345-0@lo:501: 00000100:00100000:2.0:1788869501.110209:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+14:8392:x1875765554596096:12345-0@lo:501: Request processed in 70us (189us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788869501.110216:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788869501.110295:0:8392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8912a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554596096:0@lo:501: 10000000:01000000:3.0:1788869501.110309:0:8392:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788869501.110327:0:8392:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788869501.110341:0:8392:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81534200/0xbead52e175fc2980 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbead52e175fc2987 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.110348:0:8392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81534200/0xbead52e175fc2980 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbead52e175fc2987 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.110354:0:8392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff99ff81534200/0xbead52e175fc2980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbead52e175fc2987 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.110374:0:8392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788869501.110398:0:8392:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ffc10cf800 10000000:01000000:3.0:1788869501.110403:0:8392:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788869501.110407:0:8392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788869501.110410:0:8392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788869501.110414:0:8392:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788869501.110417:0:8392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788869501.110446:0:8392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc298e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.110453:0:8392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc298e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.110461:0:8392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc298e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869501.110473:0:8392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8912a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554596224:0@lo:101: 00000100:00100000:3.0:1788869501.110499:0:8392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869501.110511:0:8392:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff85870cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1788869501.110681:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869501.110688:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ff81534200/0xbead52e175fc2980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbead52e175fc2987 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.110705:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534200 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1788869501.110709:0:7425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ff81534200/0xbead52e175fc2980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbead52e175fc2987 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.110717:0:7425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ff81534200/0xbead52e175fc2980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xbead52e175fc2987 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869501.111711:0:7425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ff81534200/0xbead52e175fc2980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xbead52e175fc2987 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869501.111719:0:7425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869501.111827:0:7425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ff81534200/0xbead52e175fc2980 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbead52e175fc2987 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.111834:0:7425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869501.111865:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ff81534200/0xbead52e175fc2980 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbead52e175fc2987 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.111873:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ff81534200/0xbead52e175fc2980 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbead52e175fc2987 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.111891:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869501.111893:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869501.111895:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869501.111907:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869501.111923:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554596352:0@lo:103: 00000100:00100000:2.0:1788869501.111972:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.112014:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554596224 00000100:00100000:2.0:1788869501.112022:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554596224 00000100:00100000:2.0:1788869501.112066:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788869501.112073:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+14:8392:x1875765554596224:12345-0@lo:101: 00010000:00010000:2.0:1788869501.112085:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869501.112099:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff81534800/0xbead52e175fc2995 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc298e expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.112120:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff81534800/0xbead52e175fc2995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc298e expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.112130:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff81534800/0xbead52e175fc2995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc298e expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.112138:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534800, rc 0) 00000100:00100000:2.0:1788869501.112172:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+15:8392:x1875765554596224:12345-0@lo:101: Request processed in 99us (1672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869501.112178:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788869501.112209:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554596352 00000100:00100000:2.0:1788869501.112212:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554596352 00000100:00100000:2.0:1788869501.112237:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788869501.112242:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+15:3617:x1875765554596352:12345-0@lo:103: 00010000:00010000:2.0:1788869501.112266:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869501.112278:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff81534e00/0xbead52e175fc2987 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbead52e175fc2980 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.112289:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869501.112315:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+14:3617:x1875765554596352:12345-0@lo:103: Request processed in 73us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869501.112321:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869501.113712:0:8392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8912a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554596224:0@lo:101: 00010000:00010000:3.0:1788869501.113747:0:8392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc298e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2995 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.113759:0:8392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc298e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2995 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869501.113865:0:8392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8912a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554596480:0@lo:501: 00000100:00100000:3.0:1788869501.113908:0:8392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869501.113945:0:8392:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff85870cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869501.114079:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554596480 00000100:00100000:1.0:1788869501.114086:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554596480 00000100:00100000:1.0:1788869501.114130:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788869501.114138:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+14:8392:x1875765554596480:12345-0@lo:501: 00000100:00100000:1.0:1788869501.114249:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+14:8392:x1875765554596480:12345-0@lo:501: Request processed in 112us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869501.114293:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788869501.115279:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554596352:0@lo:103: 00000100:00100000:3.0:1788869501.115657:0:8392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8912a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554596480:0@lo:501: 00000100:00100000:3.0:1788869501.115697:0:8392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8912a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554596608:0@lo:503: 00000100:00100000:3.0:1788869501.115817:0:8392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869501.115850:0:8392:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff85870cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869501.115870:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554596608 00000100:00100000:3.0:1788869501.115875:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554596608 00000100:00100000:3.0:1788869501.115914:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788869501.115921:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+14:8392:x1875765554596608:12345-0@lo:503: 00000100:00100000:2.0:1788869501.116632:0:8392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8912a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554596608:0@lo:503: 00000100:00100000:3.0:1788869501.116802:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+14:8392:x1875765554596608:12345-0@lo:503: Request processed in 880us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.116810:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000040:00080000:2.0:1788869501.117106:0:8392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788869501.117173:0:8392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554596736:0@lo:502: 00000100:00100000:2.0:1788869501.117217:0:8392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.117274:0:8392:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869501.117834:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554596736 00000100:00100000:0.0:1788869501.117841:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554596736 00000100:00100000:0.0:1788869501.117886:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788869501.117894:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+14:8392:x1875765554596736:12345-0@lo:502: 00000100:00100000:0.0:1788869501.118001:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+14:8392:x1875765554596736:12345-0@lo:502: Request processed in 106us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869501.118007:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788869501.118154:0:8392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554596736:0@lo:502: 00000040:00080000:3.0:1788869501.118437:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788869501.118465:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788869501.118479:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788869501.118491:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788869501.118504:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788869501.118517:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788869501.118555:0:8392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8913480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554596864:0@lo:502: 00000100:00100000:3.0:1788869501.118597:0:8392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869501.118634:0:8392:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff85870900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869501.118856:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554596864 00000100:00100000:0.0:1788869501.118862:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554596864 00000100:00100000:0.0:1788869501.118897:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788869501.118904:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+14:8392:x1875765554596864:12345-0@lo:502: 00000100:00100000:0.0:1788869501.118983:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+14:8392:x1875765554596864:12345-0@lo:502: Request processed in 78us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869501.118989:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788869501.122316:0:8392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8913480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554596864:0@lo:502: 00000040:00080000:3.0:1788869501.122432:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788869501.122447:0:8392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788869501.125705:0:8415:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788869501.125717:0:8415:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788869501.125728:0:8415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869501.125731:0:8415:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788869501.125737:0:8415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788869501.125754:0:8415:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99ffc10f19c0) 00000020:00000080:3.0:1788869501.125777:0:8415:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788869501.125782:0:8415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788869501.125866:0:8415:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffc10cf800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788869501.125874:0:8415:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788869501.125880:0:8415:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbead52e175fc29a3 00010000:00010000:3.0:1788869501.157016:0:8415:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1788869501.157642:0:8415:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788869501.170126:0:8415:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788869501.170868:0:8415:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788869501.188991:0:8415:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1788869501.189856:0:8415:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1788869501.197159:0:8415:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788869501.201507:0:8415:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788869501.201519:0:8415:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869501.201526:0:8415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869501.201528:0:8415:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788869501.201543:0:8415:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869501.201548:0:8415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869501.201550:0:8415:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788869501.201553:0:8415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788869501.201554:0:8415:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788869501.201575:0:8415:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869501.201578:0:8415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869501.201579:0:8415:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788869501.201583:0:8415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788869501.203628:0:8392:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788869501.203667:0:8392:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788869501.203695:0:8392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc298e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2995 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.203708:0:8392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc298e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2995 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869501.203716:0:8392:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ffc10cf800 from 1 10000000:01000000:0.0:1788869501.203727:0:8392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788869501.203773:0:8392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc29aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.203782:0:8392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc29aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.203793:0:8392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc29aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869501.203814:0:8392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554596992:0@lo:101: 00000100:00100000:0.0:1788869501.203875:0:8392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869501.203920:0:8392:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff87cc60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869501.203945:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554596992 00000100:00100000:0.0:1788869501.203951:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554596992 00000100:00100000:0.0:1788869501.204000:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788869501.204012:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+14:8392:x1875765554596992:12345-0@lo:101: 00010000:00010000:0.0:1788869501.204044:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869501.204062:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff80030c00/0xbead52e175fc29b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc29aa expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.204084:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff80030c00/0xbead52e175fc29b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc29aa expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.204094:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff80030c00/0xbead52e175fc29b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc29aa expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.204102:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80030c00, rc 0) 00000100:00100000:0.0:1788869501.204140:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+15:8392:x1875765554596992:12345-0@lo:101: Request processed in 131us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869501.204155:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788869501.204203:0:8392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554596992:0@lo:101: 00010000:00010000:0.0:1788869501.204217:0:8392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc29aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc29b1 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.204225:0:8392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc29aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc29b1 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869501.205815:0:8392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554597120:0@lo:501: 00000100:00100000:0.0:1788869501.205867:0:8392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869501.205909:0:8392:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8860ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869501.206115:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554597120 00000100:00100000:2.0:1788869501.206122:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554597120 00000100:00100000:2.0:1788869501.206167:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788869501.206175:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:8392:x1875765554597120:12345-0@lo:501: 00000100:00100000:2.0:1788869501.207673:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:8392:x1875765554597120:12345-0@lo:501: Request processed in 1494us (1800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869501.207683:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788869501.207810:0:8392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554597120:0@lo:501: 00000100:00100000:1.0:1788869501.207860:0:8392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554597248:0@lo:503: 00000100:00100000:1.0:1788869501.207911:0:8392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869501.207944:0:8392:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff83977000 going to sleep for 11 seconds 00000100:00100000:2.0:1788869501.208074:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554597248 00000100:00100000:2.0:1788869501.208080:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554597248 00000100:00100000:2.0:1788869501.208116:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788869501.208125:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+15:8392:x1875765554597248:12345-0@lo:503: 00000100:00100000:2.0:1788869501.208231:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+15:8392:x1875765554597248:12345-0@lo:503: Request processed in 107us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869501.208238:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788869501.208526:0:8392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554597248:0@lo:503: 00000040:00080000:1.0:1788869501.208773:0:8392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788869501.208857:0:8392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554597376:0@lo:502: 00000100:00100000:1.0:1788869501.208896:0:8392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869501.208927:0:8392:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff83977000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869501.209413:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554597376 00000100:00100000:3.0:1788869501.209419:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554597376 00000100:00100000:3.0:1788869501.209494:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788869501.209503:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+15:8392:x1875765554597376:12345-0@lo:502: 00000100:00100000:3.0:1788869501.209615:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+15:8392:x1875765554597376:12345-0@lo:502: Request processed in 114us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.209621:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788869501.209718:0:8392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554597376:0@lo:502: 00000040:00080000:1.0:1788869501.209915:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788869501.209943:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788869501.209967:0:8392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554597504:0@lo:502: 00000100:00100000:1.0:1788869501.210004:0:8392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869501.215899:0:8392:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff83977000 going to sleep for 11 seconds 00000100:00100000:0.0:1788869501.216219:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554597504 00000100:00100000:0.0:1788869501.216230:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554597504 00000100:00100000:2.0:1788869501.216525:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788869501.216549:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+15:8392:x1875765554597504:12345-0@lo:502: 00000100:00100000:2.0:1788869501.216729:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+15:8392:x1875765554597504:12345-0@lo:502: Request processed in 184us (6723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869501.216736:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788869501.216802:0:8392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554597504:0@lo:502: 00000040:00080000:2.0:1788869501.216895:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788869501.216909:0:8392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788869501.217189:0:8419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869501.217198:0:8419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869501.217201:0:8419:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788869501.217206:0:8419:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffc10cf800 00000020:00000080:2.0:1788869501.217209:0:8419:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788869501.217228:0:8419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869501.217231:0:8419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869501.217232:0:8419:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788869501.217235:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788869501.217294:0:8392:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788869501.217313:0:8392:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788869501.217328:0:8392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc29aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc29b1 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.217660:0:8392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc29aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc29b1 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869501.217707:0:8392:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788869501.217711:0:8392:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ffc10cf800 10000000:01000000:2.0:1788869501.217714:0:8392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ffc10cf800 10000000:01000000:2.0:1788869501.217717:0:8392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788869501.217723:0:8392:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ffc10cf800 from 1 10000000:01000000:2.0:1788869501.217726:0:8392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788869501.217762:0:8392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81534e00/0xbead52e175fc29b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.217771:0:8392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ff81534e00/0xbead52e175fc29b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.217793:0:8392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ff81534e00/0xbead52e175fc29b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869501.217816:0:8392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554597632:0@lo:101: 00000100:00100000:2.0:1788869501.217868:0:8392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.217906:0:8392:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd780 going to sleep for 11 seconds 00000100:00100000:3.0:1788869501.218621:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554597632 00000100:00100000:3.0:1788869501.218629:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554597632 00000100:00100000:3.0:1788869501.218664:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788869501.218672:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+15:8392:x1875765554597632:12345-0@lo:101: 00010000:00010000:3.0:1788869501.218683:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869501.218706:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb9a9fe00/0xbead52e175fc29bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc29b8 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.218731:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb9a9fe00/0xbead52e175fc29bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc29b8 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.218742:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb9a9fe00/0xbead52e175fc29bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc29b8 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.218752:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9fe00, rc 0) 00000100:00100000:3.0:1788869501.218804:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+16:8392:x1875765554597632:12345-0@lo:101: Request processed in 131us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.218810:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788869501.218899:0:8392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554597632:0@lo:101: 00010000:00010000:2.0:1788869501.218914:0:8392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ff81534e00/0xbead52e175fc29b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc29bf expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.218923:0:8392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ff81534e00/0xbead52e175fc29b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc29bf expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869501.219002:0:8392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554597760:0@lo:501: 00000100:00100000:2.0:1788869501.219042:0:8392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.219069:0:8392:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd780 going to sleep for 11 seconds 00000100:00100000:1.0:1788869501.219157:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554597760 00000100:00100000:1.0:1788869501.219163:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554597760 00000100:00100000:1.0:1788869501.219184:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788869501.219191:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+16:8392:x1875765554597760:12345-0@lo:501: 00000100:00100000:1.0:1788869501.219301:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+16:8392:x1875765554597760:12345-0@lo:501: Request processed in 110us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869501.219307:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788869501.219585:0:8392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554597760:0@lo:501: 00000100:00100000:2.0:1788869501.219613:0:8392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554597888:0@lo:503: 00000100:00100000:2.0:1788869501.219651:0:8392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.219678:0:8392:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd780 going to sleep for 11 seconds 00000100:00100000:1.0:1788869501.220184:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554597888 00000100:00100000:1.0:1788869501.220189:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554597888 00000100:00100000:1.0:1788869501.220232:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788869501.220239:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+16:8392:x1875765554597888:12345-0@lo:503: 00000100:00100000:1.0:1788869501.220369:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+16:8392:x1875765554597888:12345-0@lo:503: Request processed in 130us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869501.220376:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788869501.220586:0:8392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554597888:0@lo:503: 00000040:00080000:2.0:1788869501.220834:0:8392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788869501.220907:0:8392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554598016:0@lo:502: 00000100:00100000:2.0:1788869501.220947:0:8392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.220968:0:8392:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd780 going to sleep for 11 seconds 00000100:00100000:1.0:1788869501.221904:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554598016 00000100:00100000:1.0:1788869501.221912:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554598016 00000100:00100000:1.0:1788869501.221960:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788869501.221969:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+16:8392:x1875765554598016:12345-0@lo:502: 00000100:00100000:1.0:1788869501.222107:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+16:8392:x1875765554598016:12345-0@lo:502: Request processed in 139us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869501.222114:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788869501.222490:0:8392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554598016:0@lo:502: 00000040:00080000:2.0:1788869501.222723:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788869501.222754:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788869501.222768:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788869501.222780:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788869501.222791:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788869501.222803:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788869501.222814:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788869501.222826:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788869501.222841:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788869501.222854:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788869501.222868:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788869501.222880:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788869501.222894:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788869501.222908:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788869501.222922:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788869501.222935:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788869501.222948:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788869501.222965:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788869501.222985:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788869501.223000:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788869501.223013:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788869501.223526:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788869501.223557:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788869501.223570:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788869501.223598:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788869501.223613:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788869501.223626:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788869501.223636:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788869501.223647:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788869501.223661:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788869501.223673:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788869501.223698:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788869501.223711:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788869501.223723:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788869501.223736:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788869501.223747:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788869501.223759:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1788869501.223796:0:8392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554598144:0@lo:502: 00000100:00100000:2.0:1788869501.223864:0:8392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.223943:0:8392:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd780 going to sleep for 11 seconds 00000100:00100000:3.0:1788869501.224923:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554598144 00000100:00100000:3.0:1788869501.224933:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554598144 00000100:00100000:2.0:1788869501.225160:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788869501.225170:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+16:8392:x1875765554598144:12345-0@lo:502: 00000100:00100000:2.0:1788869501.225342:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+16:8392:x1875765554598144:12345-0@lo:502: Request processed in 172us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869501.225349:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788869501.225459:0:8392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554598144:0@lo:502: 00000040:00080000:3.0:1788869501.225522:0:8392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788869501.225550:0:8392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788869501.226248:0:8420:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788869501.226505:0:8420:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99ff95513380) 00000020:00000080:1.0:1788869501.226527:0:8420:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788869501.226719:0:8420:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffc10cf800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788869501.226723:0:8420:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffc10cf800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788869501.226726:0:8420:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffc10cf800 3 00010000:00080000:1.0:1788869501.226751:0:8420:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fe81f37800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.130@tcp at head 00010000:00010000:0.0:1788869501.234351:0:8420:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1788869501.234455:0:8420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788869501.234501:0:8420:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788869501.234514:0:8420:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbead52e175fc29cd 00000100:00080000:0.0:1788869501.234525:0:8420:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788869501.234542:0:8420:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99fe81f37800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788869501.234578:0:8420:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe81c8fb80 x1875765554598272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869501.234612:0:8420:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788869501.234807:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1875765554598272:0@lo:38: 00000100:00100000:2.0:1788869501.234876:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.235114:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875765554598400:0@lo:400: 00000100:00100000:2.0:1788869501.235143:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.235164:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869501.235170:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554598784:0@lo:400: 00000100:00100000:2.0:1788869501.235194:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.235227:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554598528:0@lo:400: 00000100:00100000:2.0:1788869501.235249:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.235285:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869501.235291:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554598656:0@lo:400: 00000100:00100000:2.0:1788869501.235323:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.235526:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554598272 00000100:00100000:2.0:1788869501.235550:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554598272 00000100:00100000:2.0:1788869501.235572:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554598400 00000100:00100000:2.0:1788869501.235574:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554598400 00000100:00100000:2.0:1788869501.235595:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554598656 00000100:00100000:2.0:1788869501.235597:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554598656 00000100:00100000:2.0:1788869501.235610:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869501.235618:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875765554598400:12345-0@lo:400: 00000100:00100000:2.0:1788869501.235714:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875765554598400:12345-0@lo:400: Request processed in 95us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869501.235722:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869501.235742:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869501.235748:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554598656:12345-0@lo:400: 00000100:00100000:2.0:1788869501.235780:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554598656:12345-0@lo:400: Request processed in 33us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869501.235786:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869501.235797:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788869501.235801:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1875765554598272:12345-0@lo:38: 00010000:00080000:2.0:1788869501.235821:0:6486:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 119 last 0 00000020:00000080:2.0:1788869501.235849:0:6486:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbead52e175fc29d4 00000004:00100000:2.0:1788869501.235864:0:6486:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788869501.235894:0:6486:0:(import.c:65:import_set_state_nolock()) ffff99fe81cb1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869501.235934:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875765554598272:12345-0@lo:38: Request processed in 131us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869501.235940:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788869501.235959:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554598784 00000100:00100000:2.0:1788869501.235962:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554598784 00000100:00100000:2.0:1788869501.235984:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554598528 00000100:00100000:2.0:1788869501.235987:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554598528 00000100:00100000:2.0:1788869501.236020:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788869501.236025:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554598784:12345-0@lo:400: 00000100:00100000:2.0:1788869501.236056:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554598784:12345-0@lo:400: Request processed in 31us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869501.236061:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788869501.236073:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788869501.236078:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554598528:12345-0@lo:400: 00000100:00100000:2.0:1788869501.236101:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554598528:12345-0@lo:400: Request processed in 24us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869501.236106:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788869501.236145:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ff84be4a80 x1875765554598656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869501.236157:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554598656:0@lo:400: 00000100:00100000:2.0:1788869501.236166:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554598528:0@lo:400: 00010000:00080000:2.0:1788869501.236193:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99fe81c8fb80 x1875765554598272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869501.236201:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788869501.236206:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788869501.236213:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788869501.236218:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788869501.236220:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99fe81f37800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788869501.236226:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1875765554598272:0@lo:38: 00000020:01000004:0.0:1788869501.236485:0:8420:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788869501.236500:0:8420:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff99ff955ccd40) 00000020:00000080:0.0:1788869501.236516:0:8420:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1788869501.236664:0:8420:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffc10cf800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788869501.236668:0:8420:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffc10cf800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788869501.236677:0:8420:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffc10cf800 3 00010000:00080000:0.0:1788869501.236702:0:8420:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fe81f17800@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.130@tcp at head 00010000:00010000:0.0:1788869501.243015:0:8420:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1788869501.243110:0:8420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788869501.243151:0:8420:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788869501.243165:0:8420:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xbead52e175fc29e2 00000100:00080000:0.0:1788869501.243175:0:8420:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788869501.243181:0:8420:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff99fe81f17800 using connection 192.168.201.130@tcp/0@lo 00010000:00080000:3.0:1788869501.244565:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ff84be4000 x1875765554598400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869501.244582:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875765554598400:0@lo:400: 00000100:00100000:0.0:1788869501.245019:0:8420:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe81c8f800 x1875765554598912/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869501.245078:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1875765554598912:0@lo:38: 00000100:00100000:3.0:1788869501.245141:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788869501.245418:0:8420:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788869501.245683:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554598912 00000100:00100000:2.0:1788869501.245692:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554598912 00000100:00100000:2.0:1788869501.245728:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869501.245743:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1875765554598912:12345-0@lo:38: 00010000:00080000:2.0:1788869501.245769:0:6486:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 119 last 0 00000020:00000080:2.0:1788869501.245846:0:6486:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xbead52e175fc29e9 00000004:00100000:2.0:1788869501.245862:0:6486:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788869501.245892:0:6486:0:(import.c:65:import_set_state_nolock()) ffff99fe81cb7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869501.246518:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554598784:0@lo:400: 00000100:00100000:2.0:1788869501.247908:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875765554598912:12345-0@lo:38: Request processed in 2159us (2760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869501.247919:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:2.0:1788869501.248110:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1788869501.248367:0:8392:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788869501.248397:0:8392:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788869501.248420:0:8392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81534e00/0xbead52e175fc29b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc29bf expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869501.248430:0:8392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ff81534e00/0xbead52e175fc29b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc29bf expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788869501.248475:0:8392:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788869501.248477:0:8392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788869501.248478:0:8392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869501.248479:0:8392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869501.248480:0:8392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869501.248482:0:8392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869501.248483:0:8392:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869501.248485:0:8392:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788869501.248486:0:8392:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788869501.248488:0:8392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869501.248489:0:8392:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788869501.248493:0:8392:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788869501.248496:0:8392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788869501.248497:0:8392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788869501.248498:0:8392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869501.248503:0:8392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869501.248504:0:8392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869501.248505:0:8392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869501.248506:0:8392:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869501.248507:0:8392:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788869501.248508:0:8392:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788869501.248509:0:8392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869501.248510:0:8392:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788869501.248544:0:8392:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788869501.248559:0:8392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82088e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554599040:0@lo:253: 00000100:00100000:2.0:1788869501.248617:0:8392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.248655:0:8392:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869501.248786:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554599040 00000100:00100000:0.0:1788869501.248793:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554599040 00000100:00100000:0.0:1788869501.248838:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788869501.248847:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:8392:x1875765554599040:12345-0@lo:253: 20000000:01000000:0.0:1788869501.248871:0:6476:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788869501.248883:0:6476:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1788869501.250922:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99fe81c8f800 x1875765554598912/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869501.250935:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788869501.250943:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788869501.250950:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788869501.250960:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788869501.250964:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99fe81f17800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788869501.250970:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1875765554598912:0@lo:38: 20000000:01000000:3.0:1788869501.253708:0:6476:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788869501.253729:0:6476:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788869501.253986:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:8392:x1875765554599040:12345-0@lo:253: Request processed in 5135us (5362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.253997:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 20000000:01000000:0.0:1788869501.254072:0:6500:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788869501.254078:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788869501.254099:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ff80031e00/0xbead52e175fc29f0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.254113:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ff829cea00/0xbead52e175fc28e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc28df expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.254121:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ff81535200/0xbead52e175fc2902 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc28fb expref: 15 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.254140:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ff80031e00/0xbead52e175fc29f0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.254174:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ff81535200/0xbead52e175fc2902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc28fb expref: 15 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.254187:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ff81535200/0xbead52e175fc2902 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc28fb expref: 15 pid: 6476 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869501.254200:0:6500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1875765554599168:0@lo:104: 00000100:00100000:0.0:1788869501.254236:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788869501.254306:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ff829cea00/0xbead52e175fc28e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc28df expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869501.254315:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ff829cea00/0xbead52e175fc28e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc28df expref: 15 pid: 6479 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869501.254322:0:6500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1875765554599296:0@lo:104: 00000100:00100000:3.0:1788869501.254423:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788869501.254435:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554599168 00000100:00100000:3.0:1788869501.254442:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554599168 00000100:00100000:3.0:1788869501.254485:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788869501.254493:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8a5c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+3:6500:x1875765554599168:12345-0@lo:104: 00010000:00010000:3.0:1788869501.254505:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ff829cf400/0xbead52e175fc28fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2902 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.254556:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788869501.254562:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8a5c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+3:6500:x1875765554599168:12345-0@lo:104: Request processed in 70us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.254567:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1788869501.254601:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869501.254607:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ff829cf400/0xbead52e175fc28fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2902 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.254613:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff829cf400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1788869501.254617:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ff829cf400/0xbead52e175fc28fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2902 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.254625:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ff829cf400/0xbead52e175fc28fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2902 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869501.254638:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ff829cf400/0xbead52e175fc28fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2902 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869501.254644:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788869501.254672:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ff829cf400/0xbead52e175fc28fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2902 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.254679:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869501.254701:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ff829cf400/0xbead52e175fc28fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2902 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.254708:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ff829cf400/0xbead52e175fc28fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2902 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.254721:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869501.254723:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869501.254724:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869501.254742:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554599424:0@lo:103: 00000100:00100000:3.0:1788869501.254768:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869501.254804:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554599424 00000100:00100000:3.0:1788869501.254807:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554599424 00010000:00010000:3.0:1788869501.254821:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ff81535200/0xbead52e175fc2902 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc28fb expref: 16 pid: 6476 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869501.254842:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788869501.254848:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8913800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+16:3617:x1875765554599424:12345-0@lo:103: 00010000:00010000:3.0:1788869501.254857:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869501.254863:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ff81535200/0xbead52e175fc2902 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc28fb expref: 16 pid: 6476 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.254879:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ff81535200/0xbead52e175fc2902 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc28fb expref: 16 pid: 6476 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.254894:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869501.254921:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8913800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+16:3617:x1875765554599424:12345-0@lo:103: Request processed in 73us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.254928:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788869501.254960:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554599424:0@lo:103: 00000100:00100000:0.0:1788869501.255020:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869501.255044:0:6500:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8860c780 going to sleep for 11 seconds 00010000:00010000:0.0:1788869501.255057:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff81535200/0xbead52e175fc2902 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc28fb expref: 15 pid: 6476 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869501.255068:0:6500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1875765554599168:0@lo:104: 00000100:00100000:3.0:1788869501.255650:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554599296 00000100:00100000:3.0:1788869501.255655:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554599296 00000100:00100000:3.0:1788869501.255691:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788869501.255699:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+3:6500:x1875765554599296:12345-0@lo:104: 00010000:00010000:3.0:1788869501.255709:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ff81491a00/0xbead52e175fc28df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc28e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.255762:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788869501.255767:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+3:6500:x1875765554599296:12345-0@lo:104: Request processed in 70us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.255774:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1788869501.255790:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869501.255794:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ff81491a00/0xbead52e175fc28df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc28e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.255801:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81491a00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1788869501.255805:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ff81491a00/0xbead52e175fc28df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc28e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.255824:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ff81491a00/0xbead52e175fc28df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc28e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869501.255832:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ff81491a00/0xbead52e175fc28df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc28e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869501.255837:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788869501.255859:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ff81491a00/0xbead52e175fc28df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc28e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.255865:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869501.255881:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ff81491a00/0xbead52e175fc28df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc28e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.255888:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ff81491a00/0xbead52e175fc28df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc28e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.255901:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869501.255903:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869501.255904:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869501.255976:0:6500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1875765554599296:0@lo:104: 00010000:00010000:0.0:1788869501.255992:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ff80031e00/0xbead52e175fc29f0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869501.256111:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554599552:0@lo:103: 00000100:00100000:2.0:1788869501.256143:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869501.256349:0:8392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82088e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:8392:1875765554599040:0@lo:253: 10000000:01000000:2.0:1788869501.256359:0:8392:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788869501.256362:0:8392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788869501.256364:0:8392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788869501.256365:0:8392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869501.256366:0:8392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869501.256368:0:8392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869501.256369:0:8392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869501.256370:0:8392:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869501.256372:0:8392:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788869501.256373:0:8392:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788869501.256374:0:8392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869501.256376:0:8392:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788869501.256384:0:8392:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788869501.260003:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554599552 00000100:00100000:3.0:1788869501.260013:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554599552 00010000:00010000:3.0:1788869501.260046:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ff829cea00/0xbead52e175fc28e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc28df expref: 15 pid: 6479 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869501.260119:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788869501.260127:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8208a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+15:3618:x1875765554599552:12345-0@lo:103: 00010000:00010000:3.0:1788869501.260140:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869501.260145:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ff829cea00/0xbead52e175fc28e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc28df expref: 15 pid: 6479 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.260164:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ff829cea00/0xbead52e175fc28e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc28df expref: 15 pid: 6479 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.260182:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff829cea00/0xbead52e175fc28e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc28df expref: 15 pid: 6479 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.260198:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ff80031e00/0xbead52e175fc29f0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.260207:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff80031e00/0xbead52e175fc29f0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788869501.260223:0:6470:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006146070s 00010000:00010000:3.0:1788869501.260227:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ff80031e00/0xbead52e175fc29f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.260234:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ff80031e00/0xbead52e175fc29f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.260239:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ff80031e00/0xbead52e175fc29f0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.260245:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ff80031e00/0xbead52e175fc29f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.260279:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031e00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869501.260283:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ff80031e00/0xbead52e175fc29f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.260291:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ff80031e00/0xbead52e175fc29f0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.260317:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ff80031e00/0xbead52e175fc29f0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869501.260425:0:6500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ff80031e00/0xbead52e175fc29f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869501.260433:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ff80031e00/0xbead52e175fc29f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869501.260440:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff80031e00/0xbead52e175fc29f0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869501.260474:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869501.260559:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8208a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+14:3618:x1875765554599552:12345-0@lo:103: Request processed in 432us (4414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869501.260566:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788869501.260630:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554599552:0@lo:103: 00080000:10000000:2.0:1788869501.261035:0:8392:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788869501.261195:0:8392:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788869501.261610:0:8392:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788869501.261767:0:8392:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788869501.261966:0:8392:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788869501.262186:0:8392:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788869501.263620:0:8392:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788869501.281676:0:8392:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788869501.281685:0:8392:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788869501.281719:0:8392:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788869501.281764:0:8392:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788869501.281783:0:8392:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788869501.281812:0:8392:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788869501.283003:0:8392:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869501.283578:0:8392:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788869501.851667:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788869502.579614:0:8476:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869502.579825:0:8476:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788869502.873737:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788869503.386654:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788869503.386662:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ff89980800 from 30 10000000:01000000:0.0:1788869503.386668:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788869503.386713:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff80031e00/0xbead52e175fc29f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869503.386724:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ff80031e00/0xbead52e175fc29f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869503.386735:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ff80031e00/0xbead52e175fc29f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869503.386758:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554599680:0@lo:101: 00000100:00100000:0.0:1788869503.386828:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869503.386875:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89afb000 going to sleep for 11 seconds 00000100:00100000:0.0:1788869503.386897:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554599680 00000100:00100000:0.0:1788869503.386903:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554599680 00000100:00100000:0.0:1788869503.386951:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788869503.386960:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+14:6481:x1875765554599680:12345-0@lo:101: 00010000:00010000:0.0:1788869503.386973:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869503.386994:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff80031400/0xbead52e175fc29fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc29f7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869503.387019:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff80031400/0xbead52e175fc29fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc29f7 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869503.387029:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff80031400/0xbead52e175fc29fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc29f7 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869503.387037:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80031400, rc 0) 00000100:00100000:0.0:1788869503.387075:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+15:6481:x1875765554599680:12345-0@lo:101: Request processed in 116us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869503.387081:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788869503.387153:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554599680:0@lo:101: 00010000:00010000:0.0:1788869503.387168:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ff80031e00/0xbead52e175fc29f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc29fe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869503.387177:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ff80031e00/0xbead52e175fc29f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc29fe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869503.387234:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554599808:0@lo:501: 00000100:00100000:0.0:1788869503.387275:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869503.387302:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89afb000 going to sleep for 11 seconds 00000100:00100000:0.0:1788869503.387315:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554599808 00000100:00100000:0.0:1788869503.387319:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554599808 00000100:00100000:0.0:1788869503.387341:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788869503.387347:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:6481:x1875765554599808:12345-0@lo:501: 00000100:00100000:0.0:1788869503.387453:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:6481:x1875765554599808:12345-0@lo:501: Request processed in 106us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869503.387602:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788869503.387639:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554599808:0@lo:501: 00000100:00100000:0.0:1788869503.387665:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554599936:0@lo:503: 00000100:00100000:0.0:1788869503.387702:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869503.387716:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89afb000 going to sleep for 11 seconds 00000100:00100000:0.0:1788869503.387728:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554599936 00000100:00100000:0.0:1788869503.387732:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554599936 00000100:00100000:0.0:1788869503.387754:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788869503.387761:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+15:6481:x1875765554599936:12345-0@lo:503: 00000100:00100000:0.0:1788869503.387838:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+15:6481:x1875765554599936:12345-0@lo:503: Request processed in 77us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869503.387846:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788869503.387885:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554599936:0@lo:503: 00000100:00100000:0.0:1788869503.388104:0:8510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8510:1875765554600064:0@lo:502: 00000100:00100000:0.0:1788869503.388137:0:8510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869503.388155:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554600064 00000100:00100000:0.0:1788869503.388159:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554600064 00000100:00100000:0.0:1788869503.388181:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788869503.388187:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+15:8510:x1875765554600064:12345-0@lo:502: 00000100:00100000:0.0:1788869503.388277:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+15:8510:x1875765554600064:12345-0@lo:502: Request processed in 89us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869503.388426:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788869503.388459:0:8510:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8b76a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869503.389224:0:8510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8510:1875765554600064:0@lo:502: 00000100:00100000:0.0:1788869503.389373:0:8510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8510:1875765554600192:0@lo:502: 00000100:00100000:0.0:1788869503.389430:0:8510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869503.390206:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554600192 00000100:00100000:0.0:1788869503.390213:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554600192 00000100:00100000:0.0:1788869503.390278:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788869503.391388:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:8510:x1875765554600192:12345-0@lo:502: 00000100:00100000:0.0:1788869503.392692:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:8510:x1875765554600192:12345-0@lo:502: Request processed in 2403us (3257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869503.392704:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788869503.392777:0:8510:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8b76a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869503.392802:0:8510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8510:1875765554600192:0@lo:502: 00000040:00080000:0.0:1788869503.392835:0:8510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788869503.393655:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788869503.393679:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788869503.393689:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff80031e00/0xbead52e175fc29f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc29fe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869503.393701:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ff80031e00/0xbead52e175fc29f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc29fe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869503.393711:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788869503.393714:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ff89980800 from 5 10000000:01000000:0.0:1788869503.393717:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788869503.393750:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff80030a00/0xbead52e175fc2a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869503.393759:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ff80030a00/0xbead52e175fc2a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869503.393768:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ff80030a00/0xbead52e175fc2a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869503.393797:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554600320:0@lo:101: 00000100:00100000:0.0:1788869503.393844:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869503.395609:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f2900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869503.395639:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554600320 00000100:00100000:0.0:1788869503.395646:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554600320 00000100:00100000:0.0:1788869503.395694:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788869503.395703:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+15:6481:x1875765554600320:12345-0@lo:101: 00010000:00010000:0.0:1788869503.395717:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869503.396535:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb98e2200/0xbead52e175fc2a0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2a05 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869503.396568:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb98e2200/0xbead52e175fc2a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2a05 expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869503.396579:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb98e2200/0xbead52e175fc2a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2a05 expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869503.396588:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb98e2200, rc 0) 00000100:00100000:0.0:1788869503.396646:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+16:6481:x1875765554600320:12345-0@lo:101: Request processed in 943us (2801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869503.396652:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788869503.396715:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554600320:0@lo:101: 00010000:00010000:0.0:1788869503.396730:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ff80030a00/0xbead52e175fc2a05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2a0c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869503.396738:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ff80030a00/0xbead52e175fc2a05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2a0c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869503.396798:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554600448:0@lo:256: 00000100:00100000:0.0:1788869503.396829:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869503.396849:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f2900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869503.396860:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554600448 00000100:00100000:0.0:1788869503.396864:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554600448 00000100:00100000:0.0:1788869503.396889:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788869503.396894:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+16:6481:x1875765554600448:12345-0@lo:256: 20000000:01000000:0.0:1788869503.396907:0:6479:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788869503.396922:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788869503.396925:0:6479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788869503.397007:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+16:6481:x1875765554600448:12345-0@lo:256: Request processed in 112us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869503.397014:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788869503.397098:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554600448:0@lo:256: 10000000:01000000:1.0:1788869503.397212:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788869503.397220:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff80030a00/0xbead52e175fc2a05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2a0c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869503.397227:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ff80030a00/0xbead52e175fc2a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2a0c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869503.397235:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788869503.397237:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1788869503.397240:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788869503.397278:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9c00/0xbead52e175fc2a13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869503.397454:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9c00/0xbead52e175fc2a13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869503.397541:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9c00/0xbead52e175fc2a13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869503.397556:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554600576:0@lo:101: 00000100:00100000:1.0:1788869503.397585:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869503.397609:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb95ad000 going to sleep for 11 seconds 00000100:00100000:2.0:1788869503.397943:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554600576 00000100:00100000:2.0:1788869503.397948:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554600576 00000100:00100000:2.0:1788869503.397989:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788869503.397998:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88938450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:6481:x1875765554600576:12345-0@lo:101: 00010000:00010000:2.0:1788869503.398007:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869503.398021:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff81534000/0xbead52e175fc2a1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2a13 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869503.398040:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff81534000/0xbead52e175fc2a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2a13 expref: 17 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869503.398049:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff81534000/0xbead52e175fc2a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2a13 expref: 17 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869503.398058:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534000, rc 0) 00000100:00100000:2.0:1788869503.398093:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88938450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554600576:12345-0@lo:101: Request processed in 97us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869503.398098:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788869503.399421:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554600576:0@lo:101: 00010000:00010000:2.0:1788869503.399443:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9c00/0xbead52e175fc2a13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2a1a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869503.399453:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9c00/0xbead52e175fc2a13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2a1a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869503.399936:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82088e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554600704:0@lo:501: 00000100:00100000:2.0:1788869503.399984:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869503.400340:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99b8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788869503.407409:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554600704 00000100:00100000:1.0:1788869503.407424:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554600704 00000100:00100000:1.0:1788869503.407508:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788869503.407520:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88938c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554600704:12345-0@lo:501: 00000100:00100000:1.0:1788869503.407685:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88938c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554600704:12345-0@lo:501: Request processed in 168us (7699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869503.407699:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788869503.407803:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82088e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554600704:0@lo:501: 00000100:00100000:2.0:1788869503.407863:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82088e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554600832:0@lo:503: 00000100:00100000:2.0:1788869503.407909:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869503.407943:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99b8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788869503.408116:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554600832 00000100:00100000:1.0:1788869503.408121:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554600832 00000100:00100000:1.0:1788869503.408503:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788869503.408513:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554600832:12345-0@lo:503: 00000100:00100000:1.0:1788869503.408604:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554600832:12345-0@lo:503: Request processed in 92us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869503.408611:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788869503.413636:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82088e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554600832:0@lo:503: 00000100:00100000:2.0:1788869503.414578:0:8512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82088e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8512:1875765554600960:0@lo:502: 00000100:00100000:2.0:1788869503.414641:0:8512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869503.416960:0:8512:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99b80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869503.422588:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554600960 00000100:00100000:1.0:1788869503.422602:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554600960 00000100:00100000:1.0:1788869503.422708:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788869503.422718:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+17:8512:x1875765554600960:12345-0@lo:502: 00000100:00100000:1.0:1788869503.423997:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+17:8512:x1875765554600960:12345-0@lo:502: Request processed in 1276us (9350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869503.424007:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788869503.426324:0:8512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82088e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8512:1875765554600960:0@lo:502: 00000020:01000000:3.0:1788869503.426374:0:8512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788869503.426382:0:8512:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788869503.426392:0:8512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869503.426394:0:8512:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788869503.426400:0:8512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788869503.426403:0:8512:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:3.0:1788869503.426428:0:8512:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788869503.426430:0:8512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788869503.426460:0:8512:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff99ffbf90b380) 00000020:00000080:3.0:1788869503.426507:0:8512:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1788869503.426514:0:8512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788869503.426598:0:8512:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788869503.426605:0:8512:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788869503.426612:0:8512:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbead52e175fc2a28 00010000:00080000:3.0:1788869503.426641:0:8512:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fe81cca800@lustre-OST0000-osc-MDT0001: add connection 192.168.201.130@tcp at head 00010000:00010000:3.0:1788869503.426873:0:8512:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788869503.452525:0:8512:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788869503.452553:0:8512:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788869503.452762:0:8512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869503.452979:0:8512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869503.453068:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788869503.453171:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788869503.453964:0:8514:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869503.453969:0:8514:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788869503.457810:0:8512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788869503.457824:0:8512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788869503.457868:0:8512:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788869503.457900:0:8512:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbead52e175fc2a2f 00000100:00080000:3.0:1788869503.457912:0:8512:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788869503.457919:0:8512:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99fe81cca800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788869503.457956:0:8512:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffb8910e00 x1875765554601088/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869503.457990:0:8512:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788869503.458092:0:8512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869503.458097:0:8512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869503.458099:0:8512:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788869503.458102:0:8512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869503.458107:0:8512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869503.458108:0:8512:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788869503.458111:0:8512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788869503.458113:0:8512:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788869503.458141:0:8512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8913100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8512:1875765554601216:0@lo:502: 00000100:00100000:3.0:1788869503.458219:0:8512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869503.458304:0:8512:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8aa5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869503.459465:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554601088:0@lo:8: 00000100:00100000:0.0:1788869503.459527:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869503.459580:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554601088 00000100:00100000:0.0:1788869503.459587:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554601088 00000100:00100000:0.0:1788869503.459616:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869503.459623:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1875765554601088:12345-0@lo:8: 00010000:00080000:0.0:1788869503.459649:0:8399:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 121 last 0 00000020:00000080:0.0:1788869503.459677:0:8399:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbead52e175fc2a36 00002000:00100000:0.0:1788869503.459708:0:8399:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff99fe81f11000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788869503.459713:0:8399:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1788869503.459717:0:8399:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788869503.459778:0:8399:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788869503.460022:0:8399:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788869503.460046:0:8399:0:(import.c:65:import_set_state_nolock()) ffff99fe81f10800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869503.460099:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3615:x1875765554601088:12345-0@lo:8: Request processed in 474us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869503.460106:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788869503.460160:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffb8910e00 x1875765554601088/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869503.460172:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788869503.460179:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788869503.460186:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788869503.460191:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788869503.460193:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99fe81cca800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788869503.460209:0:3615:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:0.0:1788869503.460215:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554601088:0@lo:8: 00000100:00100000:0.0:1788869503.460559:0:8515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8515:1875765554601344:0@lo:700: 00000100:00100000:0.0:1788869503.460590:0:8515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869503.460618:0:8515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869503.460666:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554601344 00000100:00100000:3.0:1788869503.460671:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554601344 00000100:00100000:3.0:1788869503.460725:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869503.460733:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8515:x1875765554601344:12345-0@lo:700: 00000100:00100000:3.0:1788869503.460762:0:8407:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8910000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8407:1875765554601472:0@lo:700: 00000100:00100000:3.0:1788869503.460794:0:8407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869503.460812:0:8407:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8aa5480 going to sleep for 11 seconds 00000004:00080000:3.0:1788869503.461714:0:8514:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788869503.461782:0:8514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 121388528885ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788869503.461790:0:8514:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:0.0:1788869503.463647:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869503.465737:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554601216 00000100:00100000:2.0:1788869503.465752:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554601216 00000100:00100000:2.0:1788869503.465801:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788869503.465810:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+17:8512:x1875765554601216:12345-0@lo:502: 00000100:00100000:2.0:1788869503.465980:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+17:8512:x1875765554601216:12345-0@lo:502: Request processed in 170us (7760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869503.465988:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788869503.466050:0:8512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8913100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8512:1875765554601216:0@lo:502: 00000020:01000000:2.0:1788869503.466081:0:8512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869503.466097:0:8512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869503.466104:0:8512:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788869503.466108:0:8512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1788869503.466200:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1788869503.466219:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788869503.466229:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9c00/0xbead52e175fc2a13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2a1a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869503.466239:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9c00/0xbead52e175fc2a13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2a1a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869503.466249:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788869503.466264:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ff8b15e800 from 30 10000000:01000000:2.0:1788869503.466267:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788869503.466288:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81534a00/0xbead52e175fc2a3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869503.466296:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ff81534a00/0xbead52e175fc2a3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869503.466305:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ff81534a00/0xbead52e175fc2a3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869503.466307:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554601600:0@lo:400: 00000100:00100000:2.0:1788869503.466316:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82088a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554601728:0@lo:101: 00000100:00100000:2.0:1788869503.466344:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869503.466344:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869503.466369:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99b8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869503.466379:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554601472 00000100:00100000:1.0:1788869503.466382:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554601472 00000100:00100000:1.0:1788869503.469262:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869503.469282:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8407:x1875765554601472:12345-0@lo:700: 00000100:00100000:1.0:1788869503.469415:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554601728 00000100:00100000:1.0:1788869503.469422:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554601728 00000100:00100000:1.0:1788869503.469461:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788869503.469468:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88938850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554601728:12345-0@lo:101: 00010000:00010000:1.0:1788869503.469477:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869503.469514:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb95a9000/0xbead52e175fc2a44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2a3d expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869503.469539:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb95a9000/0xbead52e175fc2a44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2a3d expref: 18 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869503.469550:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb95a9000/0xbead52e175fc2a44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2a3d expref: 18 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869503.469560:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a9000, rc 0) 00000100:00100000:1.0:1788869503.469629:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88938850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554601728:12345-0@lo:101: Request processed in 161us (3285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869503.469636:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788869503.469674:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554601600 00000100:00100000:1.0:1788869503.469679:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554601600 00000100:00100000:1.0:1788869503.469707:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788869503.469713:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554601600:12345-0@lo:400: 00000100:00100000:1.0:1788869503.469751:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554601600:12345-0@lo:400: Request processed in 38us (3407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869503.469758:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788869503.469775:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869503.469810:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82088a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554601728:0@lo:101: 00010000:00010000:1.0:1788869503.469827:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ff81534a00/0xbead52e175fc2a3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2a44 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869503.469836:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ff81534a00/0xbead52e175fc2a3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2a44 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869503.469900:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554601856:0@lo:501: 00000100:00100000:1.0:1788869503.469939:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869503.469968:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb95ad600 going to sleep for 11 seconds 00010000:00080000:1.0:1788869503.469992:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffae6aca80 x1875765554601600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869503.470004:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554601600:0@lo:400: 00000100:00100000:1.0:1788869503.470025:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554601856 00000100:00100000:1.0:1788869503.470028:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554601856 00000100:00100000:1.0:1788869503.470048:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788869503.470054:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88939050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554601856:12345-0@lo:501: 00000100:00100000:1.0:1788869503.470166:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88939050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554601856:12345-0@lo:501: Request processed in 111us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869503.470172:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788869503.470200:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554601856:0@lo:501: 00000100:00100000:1.0:1788869503.470220:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869503.470226:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554602112:0@lo:503: 00000100:00100000:1.0:1788869503.470227:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554601984:0@lo:400: 00000100:00100000:1.0:1788869503.470268:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869503.470280:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869503.470291:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554602112 00000100:00100000:0.0:1788869503.470292:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869503.470295:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554602112 00000100:00100000:1.0:1788869503.470327:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788869503.470334:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554602112:12345-0@lo:503: 00000100:00100000:1.0:1788869503.470419:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554602112:12345-0@lo:503: Request processed in 85us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869503.470425:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788869503.470468:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554602240:0@lo:400: 00000100:00100000:2.0:1788869503.470569:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554601984 00000100:00100000:2.0:1788869503.470573:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554601984 00000100:00100000:2.0:1788869503.470599:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788869503.470605:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554601984:12345-0@lo:400: 00000004:00080000:3.0:1788869503.514929:0:7415:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 40000000:02000000:3.0:1788869503.642046:0:6491:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:0.0:1788869503.642241:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554602112:0@lo:503: 00000100:00100000:3.0:1788869503.648741:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8407:x1875765554601472:12345-0@lo:700: Request processed in 179458us (187936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869503.648762:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869503.648825:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869503.648904:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554601984:12345-0@lo:400: Request processed in 178296us (178648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869503.648912:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788869503.649088:0:8518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8913100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8518:1875765554602368:0@lo:502: 00000100:00100000:3.0:1788869503.649137:0:8518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869503.649165:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554602368 00000100:00100000:3.0:1788869503.649171:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554602368 00000100:00100000:3.0:1788869503.649209:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788869503.649217:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88939c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+18:8518:x1875765554602368:12345-0@lo:502: 00000100:00100000:3.0:1788869503.649366:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88939c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+18:8518:x1875765554602368:12345-0@lo:502: Request processed in 149us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869503.649373:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788869503.650368:0:8518:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8aa5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788869503.650394:0:8518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8913100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8518:1875765554602368:0@lo:502: 00000100:00100000:3.0:1788869503.650452:0:8518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8913100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8518:1875765554602496:0@lo:502: 00000100:00100000:3.0:1788869503.651138:0:8518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869503.651181:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554602496 00000100:00100000:3.0:1788869503.651187:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554602496 00000100:00100000:3.0:1788869503.651225:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788869503.651232:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88939850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+18:8518:x1875765554602496:12345-0@lo:502: 00000100:00100000:3.0:1788869503.651646:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88939850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+18:8518:x1875765554602496:12345-0@lo:502: Request processed in 413us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869503.651654:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788869503.651885:0:8518:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8aa5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788869503.651904:0:8518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8913100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8518:1875765554602496:0@lo:502: 00000040:00080000:3.0:1788869503.651944:0:8518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788869503.652125:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788869503.652145:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788869503.652155:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81534a00/0xbead52e175fc2a3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2a44 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869503.652167:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ff81534a00/0xbead52e175fc2a3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2a44 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869503.652176:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788869503.652179:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ff8b15e800 from 5 10000000:01000000:3.0:1788869503.652182:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788869503.652209:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2a4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869503.652217:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2a4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869503.652225:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2a4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869503.652242:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8913100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554602624:0@lo:101: 00010000:00080000:0.0:1788869503.652406:0:8407:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffb8910000 x1875765554601472/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788869519 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869503.652419:0:8407:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8910000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8407:1875765554601472:0@lo:700: 40000000:02000000:0.0:1788869503.652434:0:8407:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:3.0:1788869503.652564:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869503.652589:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8aa5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788869503.652605:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554602624 00000100:00100000:3.0:1788869503.652609:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554602624 00000100:00100000:3.0:1788869503.652640:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788869503.652647:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88939450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554602624:12345-0@lo:101: 00010000:00010000:3.0:1788869503.652665:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869503.652677:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2a52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2a4b expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869503.652698:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2a4b expref: 19 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869503.652709:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2a4b expref: 19 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869503.653341:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9e800, rc 0) 00000100:00100000:3.0:1788869503.653386:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88939450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+19:6481:x1875765554602624:12345-0@lo:101: Request processed in 738us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869503.653393:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788869503.653439:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8913100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554602624:0@lo:101: 00010000:00010000:3.0:1788869503.653453:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2a4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2a52 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869503.653463:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2a4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2a52 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869503.653928:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8913100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554602752:0@lo:256: 00000100:00100000:3.0:1788869503.653964:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869503.654174:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8aa5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788869503.654195:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554602752 00000100:00100000:3.0:1788869503.654200:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554602752 00000100:00100000:3.0:1788869503.654233:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788869503.654241:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88938050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+19:6481:x1875765554602752:12345-0@lo:256: 20000000:01000000:3.0:1788869503.654558:0:6476:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788869503.654574:0:6476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788869503.654577:0:6476:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788869503.654674:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88938050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+19:6481:x1875765554602752:12345-0@lo:256: Request processed in 434us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869503.654681:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788869503.654729:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8913100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554602752:0@lo:256: 10000000:01000000:3.0:1788869503.655370:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788869503.655381:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2a4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2a52 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869503.655391:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2a52 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869503.655399:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788869503.655401:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788869503.655404:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788869503.655428:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f600/0xbead52e175fc2a59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869503.655435:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f600/0xbead52e175fc2a59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869503.655443:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f600/0xbead52e175fc2a59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869503.655457:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8913100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554602880:0@lo:101: 00000100:00100000:3.0:1788869503.655852:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869503.655890:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8aa5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788869503.655917:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554602880 00000100:00100000:3.0:1788869503.655923:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554602880 00000100:00100000:3.0:1788869503.655957:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788869503.655965:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+19:6481:x1875765554602880:12345-0@lo:101: 00010000:00010000:3.0:1788869503.655976:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869503.656339:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc2a60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2a59 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869503.656362:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc2a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2a59 expref: 20 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869503.656372:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc2a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2a59 expref: 20 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869503.656381:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9e200, rc 0) 00000100:00100000:3.0:1788869503.656418:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+20:6481:x1875765554602880:12345-0@lo:101: Request processed in 454us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869503.656424:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788869503.656466:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8913100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554602880:0@lo:101: 00000100:00100000:1.0:1788869503.656670:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554603008:0@lo:400: 00000100:00100000:1.0:1788869503.656705:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869503.656764:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554603136:0@lo:400: 00000100:00100000:1.0:1788869503.656792:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869503.656820:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554602240 00000100:00100000:1.0:1788869503.656823:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554602240 00000100:00100000:1.0:1788869503.656848:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554603136 00000100:00100000:1.0:1788869503.656850:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554603136 00000100:00100000:1.0:1788869503.656869:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869503.656874:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554602240:12345-0@lo:400: 00000100:00100000:1.0:1788869503.656906:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554602240:12345-0@lo:400: Request processed in 32us (8083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869503.656913:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869503.656924:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788869503.656929:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875765554603136:12345-0@lo:400: 00000100:00100000:1.0:1788869503.656953:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875765554603136:12345-0@lo:400: Request processed in 24us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869503.656959:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788869503.656973:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788869503.656989:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffae6ac380 x1875765554603136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869503.657001:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554603136:0@lo:400: 00010000:00010000:3.0:1788869503.657363:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f600/0xbead52e175fc2a59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2a60 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869503.657375:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f600/0xbead52e175fc2a59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2a60 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869503.657430:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8913100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554603264:0@lo:501: 00000100:00100000:3.0:1788869503.657459:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869503.657636:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8aa5840 going to sleep for 11 seconds 00010000:00080000:1.0:1788869503.658149:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffae6ad500 x1875765554602240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869503.658162:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554602240:0@lo:400: 00000100:00100000:1.0:1788869503.658174:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554601984:0@lo:400: 00000100:00100000:3.0:1788869503.660861:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554603264 00000100:00100000:3.0:1788869503.660880:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554603264 00000100:00100000:3.0:1788869503.660932:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788869503.660942:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+20:6481:x1875765554603264:12345-0@lo:501: 00000100:00100000:3.0:1788869503.663346:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+20:6481:x1875765554603264:12345-0@lo:501: Request processed in 2400us (5878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869503.663359:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788869503.663431:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8913100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554603264:0@lo:501: 00000100:00100000:3.0:1788869503.665075:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8913100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554603392:0@lo:503: 00000100:00100000:3.0:1788869503.665153:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869503.665194:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8aa5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788869503.665219:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554603392 00000100:00100000:3.0:1788869503.665226:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554603392 00000100:00100000:3.0:1788869503.665285:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788869503.665294:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+20:6481:x1875765554603392:12345-0@lo:503: 00000100:00100000:3.0:1788869503.665397:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+20:6481:x1875765554603392:12345-0@lo:503: Request processed in 104us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869503.665404:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788869503.665451:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8913100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554603392:0@lo:503: 00000100:00100000:3.0:1788869503.668092:0:8519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8913100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8519:1875765554603520:0@lo:502: 00000100:00100000:3.0:1788869503.668175:0:8519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869503.668221:0:8519:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8aa5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869503.668578:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554603520 00000100:00100000:1.0:1788869503.668586:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554603520 00000100:00100000:1.0:1788869503.668638:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788869503.668647:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+20:8519:x1875765554603520:12345-0@lo:502: 00000100:00100000:1.0:1788869503.669113:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+20:8519:x1875765554603520:12345-0@lo:502: Request processed in 467us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869503.669122:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788869503.669215:0:8519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8913100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8519:1875765554603520:0@lo:502: 00000020:01000000:3.0:1788869503.669244:0:8519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788869503.669600:0:8519:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788869503.669609:0:8519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869503.669618:0:8519:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788869503.669624:0:8519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788869503.669628:0:8519:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:3.0:1788869503.669649:0:8519:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788869503.669652:0:8519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788869503.669666:0:8519:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99ffbf90cd40) 00000020:00000080:3.0:1788869503.669689:0:8519:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788869503.669695:0:8519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788869503.670223:0:8519:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788869503.670229:0:8519:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788869503.670239:0:8519:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbead52e175fc2a6e 00010000:00080000:3.0:1788869503.670327:0:8519:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffbf9b1000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:3.0:1788869503.671840:0:8519:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:2.0:1788869503.679015:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554603008 00000100:00100000:2.0:1788869503.679035:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554603008 00000100:00100000:2.0:1788869503.679089:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788869503.680541:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554603008:12345-0@lo:400: 00000100:00100000:2.0:1788869503.680644:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554603008:12345-0@lo:400: Request processed in 1547us (23938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869503.680653:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788869503.680900:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554603008:0@lo:400: 00000040:01000000:0.0:1788869503.683663:0:8519:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788869503.683688:0:8519:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788869503.684125:0:8519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869503.684440:0:8519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869503.684597:0:8519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788869503.684940:0:8519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788869503.686224:0:8522:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788869503.686230:0:8522:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000001:00100000:3.0:1788869503.693889:0:8393:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788869503.694090:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8515:x1875765554601344:12345-0@lo:700: Request processed in 233352us (233493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869503.694108:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788869503.694165:0:8515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe81c8df80 x1875765554601344/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788869519 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869503.694180:0:8515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8515:1875765554601344:0@lo:700: 00000020:00000080:0.0:1788869503.696909:0:8519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788869503.696924:0:8519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788869503.696967:0:8519:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788869503.697176:0:8519:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbead52e175fc2a75 00000100:00080000:0.0:1788869503.697188:0:8519:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788869503.697194:0:8519:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ffbf9b1000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788869503.697229:0:8519:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe81c8e680 x1875765554603648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869503.697268:0:8519:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788869503.697324:0:8519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869503.697328:0:8519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869503.697330:0:8519:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788869503.697333:0:8519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869503.697337:0:8519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869503.697338:0:8519:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788869503.697341:0:8519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788869503.697342:0:8519:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788869503.697368:0:8519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8519:1875765554603776:0@lo:502: 00000100:00100000:0.0:1788869503.697641:0:8519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869503.697690:0:8519:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869503.697829:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554603648:0@lo:8: 00000100:00100000:0.0:1788869503.697862:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869503.697923:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554603648 00000100:00100000:0.0:1788869503.697930:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554603648 00000100:00100000:0.0:1788869503.697957:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869503.697964:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3615:x1875765554603648:12345-0@lo:8: 00010000:00080000:0.0:1788869503.699123:0:8401:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 121 last 0 00000020:00000080:0.0:1788869503.699153:0:8401:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbead52e175fc2a7c 00002000:00100000:0.0:1788869503.699167:0:8401:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99fe81ccf800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788869503.699171:0:8401:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788869503.699174:0:8401:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788869503.699275:0:8401:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788869503.699299:0:8401:0:(import.c:65:import_set_state_nolock()) ffff99fe81ccb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869503.699365:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3615:x1875765554603648:12345-0@lo:8: Request processed in 1399us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869503.699374:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788869503.699421:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe81c8e680 x1875765554603648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869503.699432:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788869503.699441:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788869503.699447:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788869503.699452:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788869503.699455:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffbf9b1000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788869503.699490:0:3615:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:0.0:1788869503.699496:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554603648:0@lo:8: 00000100:00100000:3.0:1788869503.699658:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554603776 00000100:00100000:3.0:1788869503.699664:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554603776 00000100:00100000:3.0:1788869503.699701:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788869503.699719:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff85f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+20:8519:x1875765554603776:12345-0@lo:502: 00000100:00100000:3.0:1788869503.700033:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff85f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+20:8519:x1875765554603776:12345-0@lo:502: Request processed in 324us (2392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869503.700040:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788869503.700093:0:8519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:8519:1875765554603776:0@lo:502: 00000020:01000000:3.0:1788869503.700121:0:8519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869503.700128:0:8519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869503.700130:0:8519:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788869503.700135:0:8519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788869503.700244:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788869503.700292:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788869503.700302:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f600/0xbead52e175fc2a59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2a60 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869503.700312:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f600/0xbead52e175fc2a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2a60 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869503.700320:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788869503.700322:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99ff8b770000 from 1 10000000:01000000:3.0:1788869503.700325:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788869503.700351:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2a83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869503.700358:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2a83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869503.700366:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2a83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869503.700383:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8913100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554603904:0@lo:101: 00000100:00100000:3.0:1788869503.700413:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869503.700439:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8aa59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869503.700451:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554603904 00000100:00100000:3.0:1788869503.700454:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554603904 00000100:00100000:3.0:1788869503.700476:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788869503.700495:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+20:6481:x1875765554603904:12345-0@lo:101: 00010000:00010000:3.0:1788869503.700503:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869503.700514:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2a8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2a83 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869503.700543:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2a83 expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869503.700552:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2a83 expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869503.700560:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9f200, rc 0) 00000100:00100000:3.0:1788869503.700587:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554603904:12345-0@lo:101: Request processed in 93us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869503.700593:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788869503.700622:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8913100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554603904:0@lo:101: 00010000:00010000:3.0:1788869503.700633:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2a83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2a8a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869503.700641:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2a83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2a8a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869503.700681:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8913100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554604032:0@lo:501: 00000100:00100000:3.0:1788869503.700703:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869503.700716:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8aa59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869503.700727:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554604032 00000100:00100000:3.0:1788869503.700731:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554604032 00000100:00100000:3.0:1788869503.700751:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788869503.700757:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554604032:12345-0@lo:501: 00000004:00080000:2.0:1788869503.703300:0:8522:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788869503.703402:0:8522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 121630148939ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788869503.703411:0:8522:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788869503.704194:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554604032:12345-0@lo:501: Request processed in 3430us (3483us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788869503.704206:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788869503.705241:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8913100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554604032:0@lo:501: 10000000:01000000:1.0:1788869503.706623:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788869503.706639:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2a83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2a8a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869503.706651:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2a8a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788869503.708994:0:8523:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788869503.709028:0:8523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8523:1875765554604288:0@lo:7: 00000100:00100000:1.0:1788869503.709096:0:8523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869503.709121:0:8523:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb95ade40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869503.709137:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869503.709148:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554604160:0@lo:13: 00000100:00100000:1.0:1788869503.709172:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869503.709993:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554604288 00000100:00100000:3.0:1788869503.710002:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554604288 00000100:00100000:3.0:1788869503.710064:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869503.710073:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8523:x1875765554604288:12345-0@lo:7: 00000100:00080000:1.0:1788869503.710525:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788869503.717849:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788869503.722288:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554604160 00000100:00100000:1.0:1788869503.722307:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554604160 00000100:00100000:1.0:1788869503.722365:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869503.722375:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1875765554604160:12345-0@lo:13: 00002000:00000024:1.0:1788869503.722404:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923877888 avail 3692355584 00000100:00100000:1.0:1788869503.722926:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1875765554604160:12345-0@lo:13: Request processed in 551us (13751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869503.722935:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788869503.723065:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffae6aca80 x1875765554604160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869503.723086:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554604160:0@lo:13: 00000004:00080000:1.0:1788869503.729218:0:8515:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788869503.729265:0:8515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ac700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8515:1875765554604544:0@lo:7: 00000100:00100000:1.0:1788869503.729333:0:8515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869503.729387:0:8515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb95ad3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869503.729405:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554604416:0@lo:13: 00000100:00100000:1.0:1788869503.729447:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869503.729661:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788869503.729671:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788869503.730600:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554604416 00000100:00100000:1.0:1788869503.730609:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554604416 00000100:00100000:1.0:1788869503.730654:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869503.730663:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554604416:12345-0@lo:13: 00002000:00000024:1.0:1788869503.730684:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923877888 avail 3692355584 00000100:00100000:1.0:1788869503.732024:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554604416:12345-0@lo:13: Request processed in 90us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869503.732037:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788869503.732174:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffae6aca80 x1875765554604416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869503.732209:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554604416:0@lo:13: 00002000:00080000:3.0:1788869503.741686:0:8400:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788869503.741695:0:8400:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788869503.742022:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8523:x1875765554604288:12345-0@lo:7: Request processed in 31945us (32921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869503.742033:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869503.742060:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554604544 00000100:00100000:3.0:1788869503.742066:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554604544 00000100:00100000:3.0:1788869503.742107:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869503.742114:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8515:x1875765554604544:12345-0@lo:7: 00010000:00080000:1.0:1788869503.742542:0:8523:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffae6ad500 x1875765554604288/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788869519 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869503.742556:0:8523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8523:1875765554604288:0@lo:7: 00000004:00080000:1.0:1788869503.742569:0:8523:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788869503.742603:0:8523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8523:1875765554604672:0@lo:5: 00000100:00100000:1.0:1788869503.742637:0:8523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869503.742652:0:8523:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb95ade40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869503.743990:0:8401:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788869503.744004:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554604672 00000100:00100000:2.0:1788869503.744011:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554604672 00000100:00100000:2.0:1788869503.745453:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869503.745465:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8523:x1875765554604672:12345-0@lo:5: 00002000:00080000:2.0:1788869503.745845:0:8527:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788869503.745850:0:8527:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00002000:00080000:3.0:1788869503.755046:0:8400:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788869503.755059:0:8400:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788869503.755177:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8515:x1875765554604544:12345-0@lo:7: Request processed in 13057us (25838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869503.755188:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788869503.755696:0:8515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffae6ac700 x1875765554604544/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788869519 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869503.755713:0:8515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ac700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8515:1875765554604544:0@lo:7: 00000004:00080000:1.0:1788869503.755729:0:8515:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788869503.755849:0:8515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8515:1875765554604800:0@lo:5: 00000100:00100000:1.0:1788869503.755893:0:8515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869503.755923:0:8515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb95ad3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869503.755998:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554604800 00000100:00100000:2.0:1788869503.756006:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554604800 00000100:00100000:2.0:1788869503.756051:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869503.756059:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8515:x1875765554604800:12345-0@lo:5: 00002000:00080000:2.0:1788869503.756089:0:8401:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788869503.756139:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8515:x1875765554604800:12345-0@lo:5: Request processed in 80us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869503.756146:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788869503.756202:0:8515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe82229500 x1875765554604800/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869519 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869503.756223:0:8515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8515:1875765554604800:0@lo:5: 00000004:00080000:0.0:1788869503.756235:0:8515:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000001:00080000:1.0:1788869503.756390:0:8393:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788869503.756401:0:8393:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788869503.756840:0:8515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8515:1875765554604928:0@lo:5: 00000100:00100000:0.0:1788869503.756874:0:8515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869503.756904:0:8515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869503.757057:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8523:x1875765554604672:12345-0@lo:5: Request processed in 11594us (14417us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788869503.757073:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869503.757088:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554604928 00000100:00100000:2.0:1788869503.757092:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554604928 00000100:00100000:2.0:1788869503.757124:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869503.757130:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8515:x1875765554604928:12345-0@lo:5: 00002000:00080000:2.0:1788869503.757161:0:8527:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00010000:00080000:1.0:1788869503.757898:0:8523:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe82229c00 x1875765554604672/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869519 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869503.757912:0:8523:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788869503.757918:0:8523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8523:1875765554604672:0@lo:5: 00000004:00080000:1.0:1788869503.757929:0:8523:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788869503.757964:0:8523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8523:1875765554605056:0@lo:700: 00000100:00100000:1.0:1788869503.758006:0:8523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869503.758039:0:8523:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb95ade40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869503.758393:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554605056 00000100:00100000:0.0:1788869503.758400:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554605056 00000100:00100000:0.0:1788869503.758911:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869503.758925:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8523:x1875765554605056:12345-0@lo:700: 00000100:00100000:0.0:1788869503.762097:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:8515:x1875765554604928:12345-0@lo:5: Request processed in 4962us (5217us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788869503.762111:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788869503.762211:0:8515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe81c8e680 x1875765554604928/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869519 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869503.762231:0:8515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8515:1875765554604928:0@lo:5: 00000004:00080000:1.0:1788869503.762245:0:8515:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1788869503.762307:0:8515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8515:1875765554605184:0@lo:900: 00000100:00100000:1.0:1788869503.762346:0:8515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869503.762384:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554605184 00000100:00100000:0.0:1788869503.762391:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554605184 00000100:00100000:0.0:1788869503.762618:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869503.762629:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8515:x1875765554605184:12345-0@lo:900: 00000100:00100000:0.0:1788869503.762674:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8515:x1875765554605184:12345-0@lo:900: Request processed in 48us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869503.762680:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869503.762700:0:8515:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb95adc00 going to sleep for 11 seconds 00010000:00080000:0.0:1788869503.762714:0:8515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe8222b800 x1875765554605184/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788869519 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869503.762724:0:8515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8515:1875765554605184:0@lo:900: 00000001:00080000:2.0:1788869503.778241:0:8393:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:3.0:1788869503.778690:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8523:x1875765554605056:12345-0@lo:700: Request processed in 19766us (20679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869503.778705:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788869503.778952:0:8523:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe82229c00 x1875765554605056/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788869519 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869503.779016:0:8523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8523:1875765554605056:0@lo:700: 00000004:02000040:3.0:1788869503.784137:0:8523:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1788869503.796197:0:8523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8910e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8523:1875765554605312:0@lo:5: 00000100:00100000:3.0:1788869503.798432:0:8523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869503.798658:0:8523:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae6bd480 going to sleep for 11 seconds 00000100:00100000:1.0:1788869503.799065:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554605312 00000100:00100000:1.0:1788869503.799076:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554605312 00000100:00100000:1.0:1788869503.799123:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788869503.799132:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8523:x1875765554605312:12345-0@lo:5: 00002000:00080000:0.0:1788869503.808381:0:8399:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788869503.808401:0:8399:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1788869503.810042:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8523:x1875765554605312:12345-0@lo:5: Request processed in 10905us (11610us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788869503.810056:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788869503.810444:0:8523:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffb8910e00 x1875765554605312/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869519 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869503.810462:0:8523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8910e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8523:1875765554605312:0@lo:5: 00000004:00080000:3.0:1788869503.811327:0:8523:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:1.0:1788869503.899846:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869504.410208:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8208aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554605440:0@lo:41: 00000100:00100000:0.0:1788869504.410364:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869504.410507:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554605440 00000100:00100000:2.0:1788869504.410515:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554605440 00000100:00100000:2.0:1788869504.410568:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788869504.410577:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554605440:12345-0@lo:41: 00000004:00000024:2.0:1788869504.410611:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788869504.410660:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554605440:12345-0@lo:41: Request processed in 84us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869504.410667:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788869504.410711:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8208aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554605440:0@lo:41: 00010000:00010000:2.0:1788869504.924607:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869505.947588:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869505.950609:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554605568:0@lo:41: 00000100:00100000:0.0:1788869505.950674:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869505.952996:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554605568 00000100:00100000:3.0:1788869505.953009:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554605568 00000100:00100000:3.0:1788869505.953057:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788869505.953065:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554605568:12345-0@lo:41: 00000004:00000024:3.0:1788869505.953096:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788869505.953166:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554605568:12345-0@lo:41: Request processed in 101us (2491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869505.953172:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788869505.953215:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554605568:0@lo:41: 00010000:00010000:3.0:1788869506.968374:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869507.992401:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788869508.454780:0:8775:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788869509.017854:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554605696:0@lo:13: 00000100:00100000:1.0:1788869509.017922:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869509.018017:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554605696 00000100:00100000:1.0:1788869509.018025:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554605696 00000100:00100000:1.0:1788869509.018075:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869509.018085:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554605696:12345-0@lo:13: 00002000:00000024:1.0:1788869509.018113:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869509.018157:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554605696:12345-0@lo:13: Request processed in 73us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869509.018308:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788869509.018328:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869509.018393:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe82229c00 x1875765554605696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869509.018405:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788869509.018426:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554605696:0@lo:13: 00010000:00010000:3.0:1788869509.018978:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869509.019392:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8208aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554605952:0@lo:400: 00000100:00100000:3.0:1788869509.019447:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869509.019480:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8208b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554606464:0@lo:400: 00000100:00100000:3.0:1788869509.019505:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869509.019529:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788869509.019535:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554606080:0@lo:400: 00000100:00100000:3.0:1788869509.019557:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869509.019572:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554606592:0@lo:400: 00000100:00100000:3.0:1788869509.019590:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869509.019618:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554606464 00000100:00100000:3.0:1788869509.019624:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554606464 00000100:00100000:3.0:1788869509.019666:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788869509.019673:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554606464:12345-0@lo:400: 00000100:00100000:3.0:1788869509.019743:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554606464:12345-0@lo:400: Request processed in 71us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869509.019750:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788869509.019784:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8208b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554606464:0@lo:400: 00000100:00100000:2.0:1788869509.020126:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554605952 00000100:00100000:2.0:1788869509.020131:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554605952 00000100:00100000:2.0:1788869509.020159:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788869509.020179:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+21:3618:x1875765554605952:12345-0@lo:400: 00000100:00100000:2.0:1788869509.020217:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+21:3618:x1875765554605952:12345-0@lo:400: Request processed in 52us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869509.020222:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788869509.021782:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554606080 00000100:00100000:1.0:1788869509.021792:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554606080 00000100:00100000:1.0:1788869509.021835:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554606592 00000100:00100000:1.0:1788869509.021838:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554606592 00000100:00100000:1.0:1788869509.021865:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788869509.021872:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554606080:12345-0@lo:400: 00000100:00100000:1.0:1788869509.021940:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554606080:12345-0@lo:400: Request processed in 68us (2380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869509.021947:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788869509.021963:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788869509.021969:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554606592:12345-0@lo:400: 00000100:00100000:1.0:1788869509.021996:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554606592:12345-0@lo:400: Request processed in 28us (2405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869509.022001:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788869509.022043:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554605824:0@lo:13: 00000100:00100000:1.0:1788869509.022079:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869509.022104:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8208b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554606336:0@lo:400: 00000100:00100000:1.0:1788869509.022124:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869509.022138:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554606848:0@lo:400: 00000100:00100000:1.0:1788869509.022184:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869509.022209:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788869509.022216:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82088700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554606208:0@lo:400: 00000100:00100000:1.0:1788869509.022240:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869509.022674:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8208a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554606720:0@lo:400: 00000100:00100000:1.0:1788869509.022700:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869509.022819:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554606336 00000100:00100000:2.0:1788869509.022824:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554606336 00000100:00100000:2.0:1788869509.022855:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788869509.022861:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554606336:12345-0@lo:400: 00000100:00100000:2.0:1788869509.022895:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554606336:12345-0@lo:400: Request processed in 34us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869509.022900:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788869509.022976:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe8208b480 x1875765554606336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869509.022990:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8208b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554606336:0@lo:400: 00000100:00100000:2.0:1788869509.023132:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554606720 00000100:00100000:2.0:1788869509.023136:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554606720 00000100:00100000:2.0:1788869509.023156:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788869509.023162:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554606720:12345-0@lo:400: 00000100:00100000:2.0:1788869509.023203:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554606720:12345-0@lo:400: Request processed in 42us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869509.023209:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788869509.023398:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869509.023403:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869509.023417:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554605824 00000100:00100000:2.0:1788869509.023421:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554605824 00000100:00100000:2.0:1788869509.023454:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788869509.023460:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875765554605824:12345-0@lo:13: 00002000:00000024:2.0:1788869509.023476:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869509.023508:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875765554605824:12345-0@lo:13: Request processed in 48us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869509.023514:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788869509.023527:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869509.024495:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe8208a300 x1875765554606720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869509.024510:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8208a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554606720:0@lo:400: 00010000:00080000:1.0:1788869509.024522:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffb8912a00 x1875765554605824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869509.024538:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554605824:0@lo:13: 00000100:00100000:1.0:1788869509.024574:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554606848 00000100:00100000:1.0:1788869509.024578:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554606848 00000100:00100000:1.0:1788869509.024617:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869509.024624:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82229f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875765554606848:12345-0@lo:400: 00000100:00100000:1.0:1788869509.024686:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82229f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875765554606848:12345-0@lo:400: Request processed in 63us (2502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869509.024692:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788869509.025050:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe82088000 x1875765554606080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869509.025061:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554606080:0@lo:400: 00010000:00080000:3.0:1788869509.025074:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe82089c00 x1875765554606592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869509.025082:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554606592:0@lo:400: 00000100:00100000:3.0:1788869509.025093:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8208aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554605952:0@lo:400: 00000100:00100000:1.0:1788869509.027548:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554606208 00000100:00100000:1.0:1788869509.027571:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554606208 00000100:00100000:1.0:1788869509.028341:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788869509.028387:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554606208:12345-0@lo:400: 00000100:00100000:1.0:1788869509.028493:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554606208:12345-0@lo:400: Request processed in 110us (6251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869509.028500:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788869509.040767:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82088700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554606208:0@lo:400: 00010000:00080000:2.0:1788869509.040796:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe82089500 x1875765554606848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869509.040826:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554606848:0@lo:400: 00000100:00100000:0.0:1788869509.528563:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869509.534448:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554606976:0@lo:41: 00000100:00100000:0.0:1788869509.534523:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869509.534648:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554606976 00000100:00100000:2.0:1788869509.534656:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554606976 00000100:00100000:2.0:1788869509.534716:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788869509.534725:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554606976:12345-0@lo:41: 00000004:00000024:2.0:1788869509.534760:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788869509.534817:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554606976:12345-0@lo:41: Request processed in 93us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869509.534824:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788869509.534899:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554606976:0@lo:41: 00000020:00000004:0.0:1788869509.636968:0:8827:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869509.637160:0:8827:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788869510.041394:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788869510.062663:0:8393:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:3.0:1788869511.064505:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869511.064779:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869511.068420:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554607104:0@lo:41: 00000100:00100000:3.0:1788869511.068503:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869511.072396:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554607104 00000100:00100000:1.0:1788869511.072413:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554607104 00000100:00100000:0.0:1788869511.077761:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788869511.077779:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554607104:12345-0@lo:41: 00000004:00000024:0.0:1788869511.077817:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788869511.077907:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554607104:12345-0@lo:41: Request processed in 134us (9404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869511.077914:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788869511.078029:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554607104:0@lo:41: 00010000:00010000:3.0:1788869512.088470:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869513.112676:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788869513.173589:0:8928:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788869513.173797:0:8928:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788869514.136487:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554607232:0@lo:13: 00000100:00100000:1.0:1788869514.136561:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869514.136633:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554607232 00000100:00100000:1.0:1788869514.136641:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554607232 00000100:00100000:1.0:1788869514.136690:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788869514.136698:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554607232:12345-0@lo:13: 00002000:00000024:1.0:1788869514.136724:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869514.136759:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554607232:12345-0@lo:13: Request processed in 63us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869514.136766:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788869514.136782:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869514.136807:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe82228a80 x1875765554607232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869514.136823:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554607232:0@lo:13: 00000100:00100000:1.0:1788869514.136953:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554607360:0@lo:13: 00000100:00100000:1.0:1788869514.136975:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869514.137035:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554607360 00000100:00100000:0.0:1788869514.137039:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554607360 00000100:00100000:0.0:1788869514.137069:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869514.137075:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554607360:12345-0@lo:13: 00002000:00000024:0.0:1788869514.137085:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869514.137115:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554607360:12345-0@lo:13: Request processed in 40us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869514.137121:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788869514.137179:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869514.137209:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe81c8e300 x1875765554607360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869514.137218:0:3617:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788869514.137231:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554607360:0@lo:13: 00000100:00100000:2.0:1788869514.137493:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554607488:0@lo:400: 00000100:00100000:2.0:1788869514.137529:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869514.137563:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554608000:0@lo:400: 00000100:00100000:2.0:1788869514.137608:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869514.137626:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788869514.137631:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554607616:0@lo:400: 00000100:00100000:2.0:1788869514.137655:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869514.137674:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554608128:0@lo:400: 00000100:00100000:2.0:1788869514.137692:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869514.137715:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554607616 00000100:00100000:2.0:1788869514.137719:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554607616 00000100:00100000:2.0:1788869514.137744:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554608128 00000100:00100000:2.0:1788869514.137747:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554608128 00000100:00100000:2.0:1788869514.137765:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788869514.137771:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554607616:12345-0@lo:400: 00000100:00100000:2.0:1788869514.137805:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554607616:12345-0@lo:400: Request processed in 35us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869514.137817:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788869514.137829:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788869514.137834:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8208bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554608128:12345-0@lo:400: 00000100:00100000:2.0:1788869514.137862:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8208bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554608128:12345-0@lo:400: Request processed in 27us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869514.137867:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788869514.137896:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe81c8fb80 x1875765554607616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869514.137907:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554607616:0@lo:400: 00010000:00080000:2.0:1788869514.137917:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe81c8d500 x1875765554608128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869514.137923:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554608128:0@lo:400: 00000100:00080000:1.0:1788869514.137981:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869514.137991:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554607872:0@lo:400: 00000100:00100000:1.0:1788869514.138015:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869514.138039:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788869514.138045:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554607744:0@lo:400: 00000100:00100000:1.0:1788869514.138065:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869514.138083:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554608256:0@lo:400: 00000100:00100000:1.0:1788869514.138102:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869514.138125:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554608000 00000100:00100000:1.0:1788869514.138128:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554608000 00000100:00100000:1.0:1788869514.138149:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554607744 00000100:00100000:1.0:1788869514.138152:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554607744 00000100:00100000:1.0:1788869514.138164:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788869514.138170:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554608000:12345-0@lo:400: 00000100:00100000:1.0:1788869514.138207:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554608000:12345-0@lo:400: Request processed in 37us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869514.138213:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788869514.138225:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788869514.138232:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554607744:12345-0@lo:400: 00000100:00100000:1.0:1788869514.138294:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554607744:12345-0@lo:400: Request processed in 62us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869514.138300:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788869514.138315:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554607872 00000100:00100000:1.0:1788869514.138325:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554607872 00000100:00100000:1.0:1788869514.138347:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554608256 00000100:00100000:1.0:1788869514.138350:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554608256 00000100:00100000:1.0:1788869514.138367:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788869514.138372:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554607872:12345-0@lo:400: 00000100:00100000:1.0:1788869514.138400:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554607872:12345-0@lo:400: Request processed in 28us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869514.138406:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788869514.138416:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788869514.138422:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554608256:12345-0@lo:400: 00000100:00100000:1.0:1788869514.138445:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554608256:12345-0@lo:400: Request processed in 24us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869514.138451:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788869514.138465:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869514.138485:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554607744:0@lo:400: 00010000:00080000:1.0:1788869514.138493:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe81c8e300 x1875765554608256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869514.138501:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554608256:0@lo:400: 00010000:00080000:1.0:1788869514.138509:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe81c8dc00 x1875765554607872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869514.138517:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554607872:0@lo:400: 00000100:00100000:1.0:1788869514.138540:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554608000:0@lo:400: 00000100:00100000:0.0:1788869514.138617:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554607488 00000100:00100000:0.0:1788869514.138627:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554607488 00000100:00100000:0.0:1788869514.138679:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788869514.138686:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+21:3618:x1875765554607488:12345-0@lo:400: 00000100:00100000:0.0:1788869514.138721:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+21:3618:x1875765554607488:12345-0@lo:400: Request processed in 36us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869514.138727:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788869514.138765:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554607488:0@lo:400: 00010000:00010000:2.0:1788869514.141784:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788869514.318032:0:8977:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788869514.318043:0:8977:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1788869514.649626:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869514.649652:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8208b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554608384:0@lo:41: 00000100:00100000:3.0:1788869514.649723:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869514.649862:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554608384 00000100:00100000:2.0:1788869514.649869:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554608384 00000100:00100000:2.0:1788869514.649925:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788869514.649934:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554608384:12345-0@lo:41: 00000004:00000024:2.0:1788869514.649966:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788869514.650012:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554608384:12345-0@lo:41: Request processed in 79us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869514.650019:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788869514.650225:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8208b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554608384:0@lo:41: 00010000:00010000:2.0:1788869515.162931:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869516.184632:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869516.184791:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869516.184813:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554608512:0@lo:41: 00000100:00100000:2.0:1788869516.184881:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869516.185157:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554608512 00000100:00100000:0.0:1788869516.185166:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554608512 00000100:00100000:0.0:1788869516.185226:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788869516.185236:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554608512:12345-0@lo:41: 00000004:00000024:0.0:1788869516.185297:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788869516.185356:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554608512:12345-0@lo:41: Request processed in 121us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869516.185363:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788869516.185485:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554608512:0@lo:41: 00010000:00010000:2.0:1788869517.214448:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869518.242287:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869519.256521:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554608640:0@lo:13: 00000100:00100000:1.0:1788869519.256589:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869519.256679:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554608640 00000100:00100000:1.0:1788869519.256698:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554608640 00000100:00100000:1.0:1788869519.256745:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788869519.256754:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554608640:12345-0@lo:13: 00002000:00000024:1.0:1788869519.256780:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869519.256821:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554608640:12345-0@lo:13: Request processed in 69us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869519.256827:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788869519.256844:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869519.256869:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe8222b800 x1875765554608640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869519.256885:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554608640:0@lo:13: 00000100:00100000:1.0:1788869519.258711:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554608768:0@lo:13: 00000100:00100000:1.0:1788869519.258768:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869519.258796:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554609280:0@lo:400: 00000100:00100000:1.0:1788869519.258861:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869519.258881:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554609792:0@lo:400: 00000100:00100000:1.0:1788869519.258904:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869519.258926:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788869519.258932:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554608896:0@lo:400: 00000100:00100000:1.0:1788869519.258970:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869519.258996:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554609408:0@lo:400: 00000100:00100000:1.0:1788869519.259019:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869519.259055:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554609280 00000100:00100000:1.0:1788869519.259061:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554609280 00000100:00100000:1.0:1788869519.259102:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788869519.259109:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554609280:12345-0@lo:400: 00000100:00100000:1.0:1788869519.259182:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554609280:12345-0@lo:400: Request processed in 73us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869519.259188:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788869519.259209:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554609408 00000100:00100000:1.0:1788869519.259212:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554609408 00000100:00100000:1.0:1788869519.259237:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788869519.259244:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554609408:12345-0@lo:400: 00000100:00100000:1.0:1788869519.259311:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554609408:12345-0@lo:400: Request processed in 68us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869519.259317:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788869519.259355:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554609024:0@lo:400: 00000100:00100000:1.0:1788869519.259386:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869519.259405:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554609536:0@lo:400: 00000100:00100000:1.0:1788869519.259427:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869519.259443:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788869519.259449:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554609152:0@lo:400: 00000100:00100000:1.0:1788869519.259467:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869519.259482:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554609664:0@lo:400: 00000100:00100000:1.0:1788869519.259514:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869519.259538:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554609024 00000100:00100000:1.0:1788869519.259542:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554609024 00000100:00100000:1.0:1788869519.259559:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554609536 00000100:00100000:1.0:1788869519.259561:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554609536 00000100:00100000:1.0:1788869519.259583:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554609664 00000100:00100000:1.0:1788869519.259586:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554609664 00000100:00100000:1.0:1788869519.259598:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788869519.259602:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554609024:12345-0@lo:400: 00000100:00100000:1.0:1788869519.259642:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554609024:12345-0@lo:400: Request processed in 38us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869519.259648:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788869519.259660:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788869519.259666:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554609536:12345-0@lo:400: 00000100:00100000:1.0:1788869519.259691:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554609536:12345-0@lo:400: Request processed in 25us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869519.259696:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788869519.259706:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788869519.259712:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554609664:12345-0@lo:400: 00000100:00100000:1.0:1788869519.259734:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554609664:12345-0@lo:400: Request processed in 23us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869519.259740:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788869519.259756:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554609152 00000100:00100000:1.0:1788869519.259759:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554609152 00000100:00100000:1.0:1788869519.259777:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788869519.259783:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554609152:12345-0@lo:400: 00000100:00100000:1.0:1788869519.259811:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554609152:12345-0@lo:400: Request processed in 28us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869519.259815:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1788869519.259832:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869519.259836:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869519.259848:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554608768 00000100:00100000:1.0:1788869519.259851:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554608768 00000100:00100000:1.0:1788869519.259878:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788869519.259883:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554608768:12345-0@lo:13: 00002000:00000024:1.0:1788869519.259897:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869519.259936:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554608768:12345-0@lo:13: Request processed in 53us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869519.259942:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788869519.259960:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869519.259984:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554609152:0@lo:400: 00010000:00080000:1.0:1788869519.259996:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe81c8c380 x1875765554609664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869519.260006:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554609664:0@lo:400: 00010000:00080000:1.0:1788869519.260014:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe81c8ca80 x1875765554609024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869519.260021:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554609024:0@lo:400: 00010000:00080000:1.0:1788869519.260028:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe81c8e300 x1875765554609536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869519.260035:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554609536:0@lo:400: 00000100:00100000:1.0:1788869519.260067:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554609408:0@lo:400: 00010000:00080000:1.0:1788869519.260076:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe81c8f100 x1875765554608768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869519.260090:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554608768:0@lo:13: 00010000:00080000:1.0:1788869519.260100:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe81c8f480 x1875765554609280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869519.260106:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554609280:0@lo:400: 00000100:00100000:3.0:1788869519.260565:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554608896 00000100:00100000:3.0:1788869519.260570:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554608896 00000100:00100000:3.0:1788869519.260598:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788869519.260605:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8a775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:3616:x1875765554608896:12345-0@lo:400: 00000100:00100000:3.0:1788869519.260645:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8a775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:3616:x1875765554608896:12345-0@lo:400: Request processed in 41us (1674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869519.260651:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00010000:3.0:1788869519.260678:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869519.266036:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554608896:0@lo:400: 00000100:00100000:1.0:1788869519.267583:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554609792 00000100:00100000:1.0:1788869519.267602:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554609792 00000100:00100000:1.0:1788869519.267662:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869519.267671:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554609792:12345-0@lo:400: 00000100:00100000:1.0:1788869519.267754:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554609792:12345-0@lo:400: Request processed in 85us (8849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869519.267761:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788869519.267804:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe81c8d500 x1875765554609792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869519.267818:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554609792:0@lo:400: 00000100:00100000:3.0:1788869519.768591:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869519.768619:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554609920:0@lo:41: 00000100:00100000:3.0:1788869519.768689:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869519.768824:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554609920 00000100:00100000:0.0:1788869519.768832:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554609920 00000100:00100000:0.0:1788869519.768880:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788869519.768889:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554609920:12345-0@lo:41: 00000004:00000024:0.0:1788869519.768923:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788869519.768979:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554609920:12345-0@lo:41: Request processed in 91us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869519.768985:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788869519.769068:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554609920:0@lo:41: 00010000:00010000:0.0:1788869520.285849:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869521.306471:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869521.309536:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554610048:0@lo:41: 00000100:00100000:1.0:1788869521.309610:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869521.309742:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554610048 00000100:00100000:0.0:1788869521.309750:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554610048 00000100:00100000:0.0:1788869521.311173:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788869521.311188:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554610048:12345-0@lo:41: 00000004:00000024:0.0:1788869521.311242:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788869521.311327:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554610048:12345-0@lo:41: Request processed in 143us (1716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869521.311334:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788869521.315239:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554610048:0@lo:41: 00010000:00010000:3.0:1788869522.328394:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869523.356756:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869524.377190:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869524.378128:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554610176:0@lo:13: 00000100:00100000:1.0:1788869524.378188:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869524.378269:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554610176 00000100:00100000:1.0:1788869524.378275:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554610176 00000100:00100000:1.0:1788869524.378321:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788869524.378330:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554610176:12345-0@lo:13: 00002000:00000024:1.0:1788869524.378355:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869524.378396:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554610176:12345-0@lo:13: Request processed in 66us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869524.378403:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788869524.378422:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869524.378450:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffb9e04000 x1875765554610176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869524.378468:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554610176:0@lo:13: 00000100:00100000:2.0:1788869524.378648:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869524.378658:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8208ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554610304:0@lo:13: 00000100:00100000:2.0:1788869524.378689:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869524.378712:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554610304 00000100:00100000:2.0:1788869524.378715:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554610304 00000100:00100000:2.0:1788869524.378742:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788869524.378748:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554610304:12345-0@lo:13: 00002000:00000024:2.0:1788869524.378758:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869524.378786:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554610304:12345-0@lo:13: Request processed in 38us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869524.378792:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788869524.378816:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe8208ad80 x1875765554610304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869524.378828:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8208ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554610304:0@lo:13: 00000100:00080000:2.0:1788869524.378923:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869524.380346:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8208b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554610560:0@lo:400: 00000100:00100000:2.0:1788869524.380394:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869524.380422:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554611072:0@lo:400: 00000100:00100000:2.0:1788869524.380444:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869524.380474:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788869524.380480:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554610688:0@lo:400: 00000100:00100000:2.0:1788869524.380521:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869524.380540:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8208a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554611200:0@lo:400: 00000100:00100000:2.0:1788869524.380563:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869524.380589:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554610560 00000100:00100000:2.0:1788869524.380595:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554610560 00000100:00100000:2.0:1788869524.380626:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554611072 00000100:00100000:2.0:1788869524.380629:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554611072 00000100:00100000:2.0:1788869524.380651:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554611200 00000100:00100000:2.0:1788869524.380653:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554611200 00000100:00100000:2.0:1788869524.380668:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788869524.380675:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8208b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554610560:12345-0@lo:400: 00000100:00100000:2.0:1788869524.380718:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8208b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554610560:12345-0@lo:400: Request processed in 43us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869524.380726:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788869524.380741:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788869524.380747:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8208b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554611072:12345-0@lo:400: 00000100:00100000:2.0:1788869524.380771:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8208b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554611072:12345-0@lo:400: Request processed in 25us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869524.380777:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788869524.380786:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788869524.380792:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554611200:12345-0@lo:400: 00000100:00100000:2.0:1788869524.380816:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554611200:12345-0@lo:400: Request processed in 25us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869524.380822:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869524.381279:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8208ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554610432:0@lo:400: 00000100:00100000:0.0:1788869524.381312:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869524.381338:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554610944:0@lo:400: 00000100:00100000:0.0:1788869524.381363:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869524.381385:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869524.381391:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8208aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554610816:0@lo:400: 00000100:00100000:0.0:1788869524.381412:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869524.385118:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554610432 00000100:00100000:0.0:1788869524.385132:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554610432 00000100:00100000:0.0:1788869524.385192:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788869524.385202:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8a777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+21:3617:x1875765554610432:12345-0@lo:400: 00000100:00100000:0.0:1788869524.385289:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8a777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+21:3617:x1875765554610432:12345-0@lo:400: Request processed in 88us (3974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869524.385297:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788869524.385334:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554610688 00000100:00100000:0.0:1788869524.385338:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554610688 00000100:00100000:0.0:1788869524.385362:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554610944 00000100:00100000:0.0:1788869524.385366:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554610944 00000100:00100000:0.0:1788869524.385381:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788869524.385387:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554610688:12345-0@lo:400: 00000100:00100000:0.0:1788869524.385423:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554610688:12345-0@lo:400: Request processed in 36us (4902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869524.385445:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788869524.385459:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788869524.385465:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554610944:12345-0@lo:400: 00000100:00100000:0.0:1788869524.385498:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554610944:12345-0@lo:400: Request processed in 32us (4134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869524.385504:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788869524.385521:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554610816 00000100:00100000:0.0:1788869524.385524:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554610816 00000100:00100000:0.0:1788869524.385543:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788869524.385548:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554610816:12345-0@lo:400: 00000100:00100000:0.0:1788869524.385579:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554610816:12345-0@lo:400: Request processed in 30us (4165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869524.385585:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788869524.385626:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe8208aa00 x1875765554610816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869524.385641:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8208aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554610816:0@lo:400: 00000100:00100000:0.0:1788869524.385652:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8208ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554610432:0@lo:400: 00000100:00100000:0.0:1788869524.385662:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554610944:0@lo:400: 00000100:00080000:0.0:1788869524.392349:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869524.392359:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869524.393067:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554610688:0@lo:400: 00010000:00080000:2.0:1788869524.393087:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe8208a300 x1875765554611200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869524.393120:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8208a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554611200:0@lo:400: 00010000:00080000:2.0:1788869524.393135:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe8208b800 x1875765554610560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869524.393143:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8208b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554610560:0@lo:400: 00010000:00080000:2.0:1788869524.393153:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe82088000 x1875765554611072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869524.393162:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554611072:0@lo:400: 00000100:00100000:0.0:1788869524.901328:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869524.901356:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554611328:0@lo:41: 00000100:00100000:0.0:1788869524.901438:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869524.901642:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554611328 00000100:00100000:0.0:1788869524.901650:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554611328 00000100:00100000:0.0:1788869524.901713:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788869524.901722:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554611328:12345-0@lo:41: 00000004:00000024:0.0:1788869524.901758:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788869524.901803:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554611328:12345-0@lo:41: Request processed in 82us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869524.901811:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788869524.902769:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554611328:0@lo:41: 00010000:00010000:3.0:1788869525.403612:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788869526.238780:0:9475:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788869526.238784:0:9475:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788869526.238785:0:9475:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788869526.238907:0:9475:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99ffb9bbc800 00000020:01000004:0.0:1788869526.238923:0:9475:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788869526.238937:0:9475:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788869526.238960:0:9475:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99fe82334d40) 00000020:00000080:0.0:1788869526.238979:0:9475:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788869526.285742:0:9475:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788869526.285788:0:9475:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1788869526.314646:0:9475:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788869526.314942:0:9475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788869526.314955:0:9475:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788869526.315046:0:9475:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbead52e175fc2a98 00000020:01000004:0.0:1788869526.315056:0:9475:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788869526.315080:0:9475:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.130@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788869526.315083:0:9475:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788869526.315089:0:9475:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788869526.315119:0:9475:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788869526.315123:0:9475:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:2.0:1788869526.424479:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869526.425426:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8208b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554611456:0@lo:41: 00000100:00100000:3.0:1788869526.425497:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869526.425644:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554611456 00000100:00100000:2.0:1788869526.425652:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554611456 00000100:00100000:2.0:1788869526.425735:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788869526.425745:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554611456:12345-0@lo:41: 00000004:00000024:2.0:1788869526.425776:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788869526.425841:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554611456:12345-0@lo:41: Request processed in 97us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869526.425848:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788869526.425910:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8208b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554611456:0@lo:41: 00000040:01000000:2.0:1788869527.002467:0:9475:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788869527.002504:0:9475:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.130@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788869527.002508:0:9475:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788869527.002510:0:9475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788869527.002511:0:9475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869527.002512:0:9475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869527.002513:0:9475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869527.002514:0:9475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869527.002515:0:9475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869527.002517:0:9475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788869527.002518:0:9475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788869527.002523:0:9475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869527.002525:0:9475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788869527.002528:0:9475:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788869527.002530:0:9475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788869527.002531:0:9475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788869527.002532:0:9475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869527.002533:0:9475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869527.002534:0:9475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869527.002535:0:9475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869527.002536:0:9475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869527.002537:0:9475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788869527.002537:0:9475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788869527.002538:0:9475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869527.002539:0:9475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788869527.002564:0:9475:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788869527.002584:0:9475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8208a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554611584:0@lo:253: 00000100:00100000:2.0:1788869527.002653:0:9475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869527.002745:0:9475:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff83977780 going to sleep for 11 seconds 00000100:00100000:3.0:1788869527.002912:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554611584 00000100:00100000:3.0:1788869527.002921:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554611584 00000100:00100000:3.0:1788869527.003064:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788869527.003074:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8a775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+21:9475:x1875765554611584:12345-0@lo:253: 20000000:01000000:3.0:1788869527.003106:0:6476:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788869527.003110:0:6476:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788869527.003115:0:6476:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788869527.003118:0:6476:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788869527.003772:0:6476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788869527.003920:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1788869527.003935:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788869527.003951:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1788869527.003958:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788869527.003992:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1788869527.004012:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1788869527.004163:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1788869527.004180:0:6476:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.130@tcp 20000000:01000000:3.0:1788869527.004182:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.130@tcp (null) (null) (null) 00000040:00080000:3.0:1788869527.004197:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1788869527.004203:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788869527.004218:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1788869527.004223:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.130@tcp (null) (null) 00000040:00080000:3.0:1788869527.004235:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1788869527.004242:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788869527.004391:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1788869527.004414:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1788869527.004485:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1788869527.004496:0:6476:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.130@tcp 20000000:01000000:3.0:1788869527.004498:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.130@tcp (null) (null) (null) 00000040:00080000:3.0:1788869527.004511:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1788869527.004517:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788869527.004528:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1788869527.004534:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.201.130@tcp (null) (null) 00000040:00080000:3.0:1788869527.004547:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1788869527.004554:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788869527.004566:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1788869527.004583:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1788869527.004925:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1788869527.004937:0:6476:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.130@tcp 20000000:01000000:3.0:1788869527.004938:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.130@tcp (null) (null) (null) 00000040:00080000:3.0:1788869527.004963:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1788869527.004970:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788869527.004982:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1788869527.005311:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.130@tcp (null) (null) 00000040:00080000:3.0:1788869527.005334:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1788869527.005341:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788869527.005353:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1788869527.005370:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1788869527.005385:0:6476:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788869527.005387:0:6476:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788869527.005390:0:6476:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788869527.005430:0:6476:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788869527.005433:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788869527.006442:0:9482:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1788869527.006474:0:9482:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1788869527.006485:0:9482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788869527.006770:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788869527.006926:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1788869527.006939:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1788869527.006948:0:6476:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788869527.006950:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788869527.007732:0:9483:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1788869527.007753:0:9483:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1788869527.007767:0:9483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1788869527.009770:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1788869527.009892:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1788869527.009924:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1788869527.009944:0:6476:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788869527.009946:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788869527.010587:0:9484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1788869527.010783:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1788869527.010878:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1788869527.010895:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1788869527.010913:0:6476:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788869527.010914:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788869527.011484:0:9485:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1788869527.011507:0:9485:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1788869527.011534:0:9485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1788869527.011687:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1788869527.011708:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1788869527.011722:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1788869527.011730:0:6476:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788869527.011732:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788869527.271300:0:9486:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1788869527.271349:0:9486:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1788869527.271365:0:9486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1788869527.271638:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1788869527.271658:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1788869527.271670:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:2.0:1788869527.271685:0:6476:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788869527.271704:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ff81534600/0xbead52e175fc2a9f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.271722:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ff81534800/0xbead52e175fc2995 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc298e expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.271730:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb9a9fe00/0xbead52e175fc29bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc29b8 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.271736:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ff80031400/0xbead52e175fc29fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc29f7 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.271743:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ff81534000/0xbead52e175fc2a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2a13 expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.271755:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb95a9000/0xbead52e175fc2a44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2a3d expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.271761:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc2a60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2a59 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.271768:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2a8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2a83 expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.271777:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ff81534600/0xbead52e175fc2a9f lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.272101:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2a83 expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.272115:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2a8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2a83 expref: 21 pid: 6476 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869527.272130:0:6476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82089500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875765554611712:0@lo:104: 00000100:00100000:2.0:1788869527.272191:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869527.272236:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc2a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2a59 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.272244:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc2a60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2a59 expref: 21 pid: 6479 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869527.272282:0:6476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82088000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875765554611840:0@lo:104: 00000100:00100000:2.0:1788869527.272307:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869527.272333:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb95a9000/0xbead52e175fc2a44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2a3d expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.272348:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffb95a9000/0xbead52e175fc2a44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2a3d expref: 21 pid: 6476 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869527.272356:0:6476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8208ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875765554611968:0@lo:104: 00000100:00100000:2.0:1788869527.272376:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869527.272392:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ff81534000/0xbead52e175fc2a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2a13 expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.272399:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ff81534000/0xbead52e175fc2a1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2a13 expref: 21 pid: 6476 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869527.272406:0:6476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875765554612096:0@lo:104: 00000100:00100000:2.0:1788869527.272422:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869527.272435:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ff80031400/0xbead52e175fc29fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc29f7 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.272442:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ff80031400/0xbead52e175fc29fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc29f7 expref: 21 pid: 6479 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869527.272449:0:6476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875765554612224:0@lo:104: 00000100:00100000:2.0:1788869527.272463:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869527.272488:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb9a9fe00/0xbead52e175fc29bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc29b8 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.272496:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffb9a9fe00/0xbead52e175fc29bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc29b8 expref: 21 pid: 6479 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869527.272502:0:6476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82326a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875765554612352:0@lo:104: 00000100:00100000:2.0:1788869527.272528:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869527.272541:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ff81534800/0xbead52e175fc2995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc298e expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.272549:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ff81534800/0xbead52e175fc2995 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc298e expref: 21 pid: 6478 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869527.272555:0:6476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82324000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875765554612480:0@lo:104: 00000100:00100000:2.0:1788869527.272570:0:6476:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b66840 going to sleep for 11 seconds 00000100:00100000:3.0:1788869527.272660:0:6468:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788869527.272677:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869527.272691:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554611712 00000100:00100000:3.0:1788869527.272697:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554611712 00000100:00100000:3.0:1788869527.272726:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554611840 00000100:00100000:3.0:1788869527.272728:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554611840 00000100:00100000:3.0:1788869527.272736:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554611968 00000100:00100000:3.0:1788869527.272738:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554611968 00000100:00100000:3.0:1788869527.272746:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554612096 00000100:00100000:3.0:1788869527.272748:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554612096 00000100:00100000:3.0:1788869527.272756:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554612224 00000100:00100000:3.0:1788869527.272758:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554612224 00000100:00100000:3.0:1788869527.272765:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554612352 00000100:00100000:3.0:1788869527.272767:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554612352 00000100:00100000:3.0:1788869527.272775:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554612480 00000100:00100000:3.0:1788869527.272776:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554612480 00000100:00100000:3.0:1788869527.272803:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788869527.272812:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8208b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+9:6476:x1875765554611712:12345-0@lo:104: 00010000:00010000:3.0:1788869527.272825:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2a8a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.272887:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788869527.272893:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8208b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+9:6476:x1875765554611712:12345-0@lo:104: Request processed in 82us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.272905:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788869527.272922:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788869527.272928:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82089c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+8:6476:x1875765554611840:12345-0@lo:104: 00010000:00010000:3.0:1788869527.272936:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f600/0xbead52e175fc2a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2a60 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.272991:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788869527.272996:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82089c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+8:6476:x1875765554611840:12345-0@lo:104: Request processed in 70us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.273002:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788869527.273014:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788869527.273020:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8208aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+7:6476:x1875765554611968:12345-0@lo:104: 00010000:00010000:3.0:1788869527.273027:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ff81534a00/0xbead52e175fc2a3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2a44 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.273057:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788869527.273062:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8208aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+7:6476:x1875765554611968:12345-0@lo:104: Request processed in 43us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.273068:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788869527.273078:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788869527.273083:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+6:6476:x1875765554612096:12345-0@lo:104: 00010000:00010000:3.0:1788869527.273090:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9c00/0xbead52e175fc2a13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2a1a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.273113:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788869527.273117:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+6:6476:x1875765554612096:12345-0@lo:104: Request processed in 35us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.273128:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788869527.273140:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788869527.273146:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+5:6476:x1875765554612224:12345-0@lo:104: 00010000:00010000:3.0:1788869527.273153:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ff80031e00/0xbead52e175fc29f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc29fe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.273188:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788869527.273193:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+5:6476:x1875765554612224:12345-0@lo:104: Request processed in 48us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.273198:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788869527.273209:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788869527.273215:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81f06450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+4:6476:x1875765554612352:12345-0@lo:104: 00010000:00010000:3.0:1788869527.273221:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ff81534e00/0xbead52e175fc29b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc29bf expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.273245:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1788869527.273249:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81f06450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+4:6476:x1875765554612352:12345-0@lo:104: Request processed in 35us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.273281:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788869527.273310:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788869527.273316:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+3:6476:x1875765554612480:12345-0@lo:104: 00010000:00010000:3.0:1788869527.273323:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc298e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2995 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.273348:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1788869527.273352:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+3:6476:x1875765554612480:12345-0@lo:104: Request processed in 37us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.273364:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788869527.273392:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788869527.273398:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2a8a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.273405:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9ea00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1788869527.273408:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2a8a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.273416:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2a8a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869527.273423:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2a8a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869527.273429:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788869527.273458:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2a83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2a8a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.273465:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869527.273771:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788869527.273778:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f600/0xbead52e175fc2a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2a60 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869527.273785:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9f600 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:0.0:1788869527.273788:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f600/0xbead52e175fc2a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2a60 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869527.273795:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f600/0xbead52e175fc2a59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2a60 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869527.273801:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f600/0xbead52e175fc2a59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2a60 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869527.273806:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869527.273826:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f600/0xbead52e175fc2a59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2a60 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869527.273832:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869527.273864:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2a83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2a8a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.273871:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2a83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2a8a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.273883:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788869527.273887:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ff81534a00/0xbead52e175fc2a3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2a44 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.273905:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534a00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1788869527.273908:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ff81534a00/0xbead52e175fc2a3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2a44 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.273915:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ff81534a00/0xbead52e175fc2a3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2a44 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869527.273922:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ff81534a00/0xbead52e175fc2a3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2a44 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869527.273928:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788869527.273943:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ff81534a00/0xbead52e175fc2a3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2a44 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.273948:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869527.273961:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ff81534a00/0xbead52e175fc2a3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2a44 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.273968:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ff81534a00/0xbead52e175fc2a3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2a44 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.273976:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788869527.273993:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9c00/0xbead52e175fc2a13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2a1a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.273999:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a9c00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1788869527.274002:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9c00/0xbead52e175fc2a13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2a1a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274019:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9c00/0xbead52e175fc2a13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2a1a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869527.274026:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9c00/0xbead52e175fc2a13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2a1a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869527.274031:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788869527.274045:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9c00/0xbead52e175fc2a13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2a1a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274050:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869527.274056:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9c00/0xbead52e175fc2a13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2a1a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274063:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9c00/0xbead52e175fc2a13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2a1a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274071:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788869527.274074:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ff80031e00/0xbead52e175fc29f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc29fe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274079:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031e00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1788869527.274081:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ff80031e00/0xbead52e175fc29f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc29fe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274088:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ff80031e00/0xbead52e175fc29f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc29fe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869527.274093:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ff80031e00/0xbead52e175fc29f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc29fe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869527.274104:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788869527.274119:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ff80031e00/0xbead52e175fc29f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc29fe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274123:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869527.274128:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ff80031e00/0xbead52e175fc29f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc29fe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274134:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ff80031e00/0xbead52e175fc29f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc29fe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274143:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869527.274145:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ff81534e00/0xbead52e175fc29b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc29bf expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274151:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534e00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1788869527.274153:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ff81534e00/0xbead52e175fc29b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc29bf expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274159:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ff81534e00/0xbead52e175fc29b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc29bf expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869527.274164:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ff81534e00/0xbead52e175fc29b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc29bf expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869527.274170:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788869527.274180:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ff81534e00/0xbead52e175fc29b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc29bf expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274185:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869527.274196:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ff81534e00/0xbead52e175fc29b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc29bf expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274202:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ff81534e00/0xbead52e175fc29b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc29bf expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274211:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869527.274214:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc298e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2995 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274219:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9e600 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1788869527.274221:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc298e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2995 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274227:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc298e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2995 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869527.274232:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc298e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2995 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869527.274236:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788869527.274246:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc298e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2995 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274270:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869527.274273:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc298e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2995 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274279:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc298e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2995 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274287:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869527.274293:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869527.274295:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869527.274301:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869527.274314:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554612736:0@lo:103: 00000100:00100000:3.0:1788869527.274362:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869527.274395:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554613248:0@lo:103: 00000100:00100000:3.0:1788869527.274415:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869527.274435:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788869527.274440:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554612608:0@lo:103: 00000100:00100000:3.0:1788869527.274457:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869527.274471:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8208aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554613120:0@lo:103: 00000100:00100000:3.0:1788869527.274489:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869527.274505:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554612992:0@lo:103: 00000100:00100000:3.0:1788869527.274521:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869527.274530:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788869527.274534:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8208b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554612864:0@lo:103: 00000100:00100000:3.0:1788869527.274547:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869527.274555:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554613376:0@lo:103: 00000100:00100000:3.0:1788869527.274572:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869527.274590:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554612736 00000100:00100000:3.0:1788869527.274596:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554612736 00010000:00010000:3.0:1788869527.274619:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc2a60 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2a59 expref: 22 pid: 6479 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869527.274634:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554613248 00000100:00100000:3.0:1788869527.274636:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554613248 00010000:00010000:3.0:1788869527.274645:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb9a9fe00/0xbead52e175fc29bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc29b8 expref: 23 pid: 6479 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869527.274668:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554612608 00000100:00100000:3.0:1788869527.274671:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554612608 00010000:00010000:3.0:1788869527.274680:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2a8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2a83 expref: 24 pid: 6476 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869527.274689:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554613120 00000100:00100000:3.0:1788869527.274690:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554613120 00010000:00010000:3.0:1788869527.274699:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ff80031400/0xbead52e175fc29fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc29f7 expref: 25 pid: 6479 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869527.274709:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554612992 00000100:00100000:3.0:1788869527.274711:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554612992 00010000:00010000:3.0:1788869527.274729:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ff81534000/0xbead52e175fc2a1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2a13 expref: 26 pid: 6476 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869527.274739:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554612864 00000100:00100000:3.0:1788869527.274741:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554612864 00010000:00010000:3.0:1788869527.274748:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb95a9000/0xbead52e175fc2a44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2a3d expref: 27 pid: 6476 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869527.274756:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554613376 00000100:00100000:3.0:1788869527.274758:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554613376 00010000:00010000:3.0:1788869527.274765:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ff81534800/0xbead52e175fc2995 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc298e expref: 28 pid: 6478 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869527.274776:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788869527.274783:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+28:3619:x1875765554612736:12345-0@lo:103: 00010000:00010000:3.0:1788869527.274793:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869527.274798:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc2a60 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2a59 expref: 28 pid: 6479 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274817:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc2a60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2a59 expref: 28 pid: 6479 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274834:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869527.274863:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+28:3619:x1875765554612736:12345-0@lo:103: Request processed in 80us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.274870:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788869527.274884:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788869527.274889:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+27:3619:x1875765554613248:12345-0@lo:103: 00010000:00010000:3.0:1788869527.274896:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869527.274900:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb9a9fe00/0xbead52e175fc29bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc29b8 expref: 27 pid: 6479 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274908:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb9a9fe00/0xbead52e175fc29bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc29b8 expref: 27 pid: 6479 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274918:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869527.274934:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+27:3619:x1875765554613248:12345-0@lo:103: Request processed in 45us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.274939:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788869527.274948:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788869527.274953:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+26:3619:x1875765554612608:12345-0@lo:103: 00010000:00010000:3.0:1788869527.274959:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869527.274963:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2a8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2a83 expref: 26 pid: 6476 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.274972:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2a8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2a83 expref: 26 pid: 6476 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869527.275137:0:6476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82089500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875765554611712:0@lo:104: 00010000:00010000:2.0:1788869527.275147:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc2a60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2a59 expref: 26 pid: 6479 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869527.275158:0:6476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82088000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875765554611840:0@lo:104: 00000100:00100000:2.0:1788869527.275166:0:6476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8208ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875765554611968:0@lo:104: 00000100:00100000:2.0:1788869527.275173:0:6476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875765554612096:0@lo:104: 00000100:00100000:2.0:1788869527.275181:0:6476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875765554612224:0@lo:104: 00010000:00010000:2.0:1788869527.275189:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb9a9fe00/0xbead52e175fc29bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc29b8 expref: 25 pid: 6479 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869527.275196:0:6476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82326a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875765554612352:0@lo:104: 00000100:00100000:2.0:1788869527.275204:0:6476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82324000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875765554612480:0@lo:104: 00000100:00100000:1.0:1788869527.275346:0:6469:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788869527.275354:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788869527.275446:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788869527.275453:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89daa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3619:x1875765554613120:12345-0@lo:103: 00010000:00010000:1.0:1788869527.275461:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869527.275466:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ff80031400/0xbead52e175fc29fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc29f7 expref: 24 pid: 6479 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.275954:0:6476:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ff81534600/0xbead52e175fc2a9f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869527.276046:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554612736:0@lo:103: 00000100:00100000:2.0:1788869527.276055:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554613248:0@lo:103: 00010000:00010000:0.0:1788869527.276225:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f600/0xbead52e175fc2a59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2a60 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869527.276235:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f600/0xbead52e175fc2a59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2a60 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869527.276248:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869527.276266:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869527.276268:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869527.276386:0:9487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1788869527.276392:0:9487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1788869527.276463:0:9487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788869527.276472:0:9487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554612992:12345-0@lo:103: 00010000:00010000:0.0:1788869527.276481:0:9487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869527.276486:0:9487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ff81534000/0xbead52e175fc2a1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2a13 expref: 24 pid: 6476 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869527.276497:0:9487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ff81534000/0xbead52e175fc2a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2a13 expref: 24 pid: 6476 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869527.276510:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff81534000/0xbead52e175fc2a1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2a13 expref: 24 pid: 6476 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869527.276521:0:9487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869527.276564:0:9487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46892796-b77d-4866-a7cc-ce4160dea4be+23:3617:x1875765554612992:12345-0@lo:103: Request processed in 93us (2041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869527.276571:0:9487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788869527.276586:0:9487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1788869527.276592:0:9487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788869527.276598:0:9487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46892796-b77d-4866-a7cc-ce4160dea4be+22:3617:x1875765554612864:12345-0@lo:103: 00010000:00010000:0.0:1788869527.276605:0:9487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869527.276609:0:9487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb95a9000/0xbead52e175fc2a44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2a3d expref: 22 pid: 6476 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869527.276618:0:9487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb95a9000/0xbead52e175fc2a44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2a3d expref: 22 pid: 6476 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869527.276629:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb95a9000/0xbead52e175fc2a44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2a3d expref: 22 pid: 6476 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869527.276638:0:9487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869527.276665:0:9487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46892796-b77d-4866-a7cc-ce4160dea4be+21:3617:x1875765554612864:12345-0@lo:103: Request processed in 67us (2116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869527.276672:0:9487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788869527.276682:0:9487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1788869527.276687:0:9487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788869527.276693:0:9487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46892796-b77d-4866-a7cc-ce4160dea4be+20:3617:x1875765554613376:12345-0@lo:103: 00010000:00010000:0.0:1788869527.276700:0:9487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869527.276705:0:9487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ff81534800/0xbead52e175fc2995 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc298e expref: 20 pid: 6478 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869527.276713:0:9487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ff81534800/0xbead52e175fc2995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc298e expref: 20 pid: 6478 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869527.276723:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff81534800/0xbead52e175fc2995 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc298e expref: 20 pid: 6478 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869527.276732:0:9487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869527.276750:0:9487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46892796-b77d-4866-a7cc-ce4160dea4be+19:3617:x1875765554613376:12345-0@lo:103: Request processed in 58us (2178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869527.276756:0:9487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788869527.276991:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8208b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554612864:0@lo:103: 00000100:00100000:2.0:1788869527.277001:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554613376:0@lo:103: 00000100:00100000:2.0:1788869527.277007:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554612992:0@lo:103: 00010000:00010000:1.0:1788869527.277134:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ff80031400/0xbead52e175fc29fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc29f7 expref: 18 pid: 6479 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.277147:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff80031400/0xbead52e175fc29fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc29f7 expref: 18 pid: 6479 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.277157:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869527.277197:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89daa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+17:3619:x1875765554613120:12345-0@lo:103: Request processed in 1745us (2707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869527.277203:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788869527.277280:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8208aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554613120:0@lo:103: 00010000:00010000:3.0:1788869527.277468:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2a8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2a83 expref: 16 pid: 6476 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.277481:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ff81534600/0xbead52e175fc2a9f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.277489:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff81534600/0xbead52e175fc2a9f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.277503:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ff81534600/0xbead52e175fc2a9f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.277510:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ff81534600/0xbead52e175fc2a9f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.277517:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ff81534600/0xbead52e175fc2a9f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.277524:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ff81534600/0xbead52e175fc2a9f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.277530:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534600 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869527.277533:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ff81534600/0xbead52e175fc2a9f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.277541:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ff81534600/0xbead52e175fc2a9f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.277638:0:6476:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ff81534600/0xbead52e175fc2a9f lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.277646:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ff81534600/0xbead52e175fc2a9f lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788869527.277655:0:6476:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:3.0:1788869527.278928:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ff81534600/0xbead52e175fc2a9f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.278970:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff81534600/0xbead52e175fc2a9f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.278998:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869527.279070:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+15:3619:x1875765554612608:12345-0@lo:103: Request processed in 4114us (4610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.279079:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788869527.279244:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554612608:0@lo:103: 00000100:00100000:2.0:1788869527.280669:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8a775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+14:9475:x1875765554611584:12345-0@lo:253: Request processed in 277591us (278009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869527.280679:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788869527.280753:0:9475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8208a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554611584:0@lo:253: 10000000:01000000:0.0:1788869527.280767:0:9475:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788869527.280770:0:9475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788869527.280772:0:9475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788869527.280773:0:9475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788869527.280775:0:9475:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788869527.280787:0:9475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788869527.280789:0:9475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788869527.280790:0:9475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788869527.280800:0:9475:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788869527.280802:0:9475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788869527.280803:0:9475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788869527.280824:0:9475:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ffb9bbc800 from lustre-OST0001 10000000:01000000:0.0:1788869527.280853:0:9475:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788869527.280856:0:9475:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788869527.280865:0:9475:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99ff8b770000 local copy 10000000:01000000:0.0:1788869527.280869:0:9475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788869527.280900:0:9475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2aa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869527.280911:0:9475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2aa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869527.280920:0:9475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2aa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869527.280938:0:9475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554613504:0@lo:101: 00000100:00100000:0.0:1788869527.281097:0:9475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869527.281138:0:9475:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b88480 going to sleep for 11 seconds 00000100:00100000:1.0:1788869527.281186:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554613504 00000100:00100000:1.0:1788869527.281192:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554613504 00000100:00100000:1.0:1788869527.281242:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788869527.281276:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff994d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+14:9475:x1875765554613504:12345-0@lo:101: 00010000:00010000:1.0:1788869527.281289:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869527.281303:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb95a9400/0xbead52e175fc2aad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2aa6 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.281323:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb95a9400/0xbead52e175fc2aad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2aa6 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.281333:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb95a9400/0xbead52e175fc2aad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2aa6 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.281349:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a9400, rc 0) 00000100:00100000:1.0:1788869527.281385:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff994d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+15:9475:x1875765554613504:12345-0@lo:101: Request processed in 135us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869527.281390:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788869527.281465:0:9475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554613504:0@lo:101: 00010000:00010000:2.0:1788869527.281478:0:9475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2aa6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbead52e175fc2aad expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.281486:0:9475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2aa6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbead52e175fc2aad expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869527.281567:0:9475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82324000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554613632:0@lo:501: 00000100:00100000:2.0:1788869527.281594:0:9475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869527.281610:0:9475:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b66480 going to sleep for 11 seconds 00000100:00100000:2.0:1788869527.281623:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554613632 00000100:00100000:2.0:1788869527.281626:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554613632 00000100:00100000:2.0:1788869527.281666:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788869527.281673:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8d0e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:9475:x1875765554613632:12345-0@lo:501: 00000100:00100000:2.0:1788869527.281730:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8d0e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:9475:x1875765554613632:12345-0@lo:501: Request processed in 58us (135us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788869527.281738:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788869527.281768:0:9475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82324000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554613632:0@lo:501: 10000000:01000000:2.0:1788869527.281880:0:9475:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788869527.281898:0:9475:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788869527.281903:0:9475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2aa6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbead52e175fc2aad expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.281912:0:9475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2aa6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbead52e175fc2aad expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.281919:0:9475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2aa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbead52e175fc2aad expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.282104:0:9475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788869527.282128:0:9475:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ffb9bbc800 10000000:01000000:2.0:1788869527.282133:0:9475:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788869527.282138:0:9475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788869527.282141:0:9475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788869527.282144:0:9475:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788869527.282147:0:9475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788869527.282165:0:9475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2ab4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.282172:0:9475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2ab4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.282191:0:9475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2ab4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869527.282204:0:9475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82324000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554613760:0@lo:101: 00000100:00100000:2.0:1788869527.282231:0:9475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869527.282276:0:9475:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b66240 going to sleep for 11 seconds 00000100:00100000:0.0:1788869527.282323:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554613760 00000100:00100000:0.0:1788869527.282327:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554613760 00000100:00100000:0.0:1788869527.282360:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788869527.282366:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:9475:x1875765554613760:12345-0@lo:101: 00010000:00010000:0.0:1788869527.282373:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869527.282385:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb98e2000/0xbead52e175fc2abb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2ab4 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869527.282401:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb98e2000/0xbead52e175fc2abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2ab4 expref: 16 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869527.282409:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb98e2000/0xbead52e175fc2abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2ab4 expref: 16 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869527.282425:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb98e2000, rc 0) 00000100:00100000:0.0:1788869527.282455:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:9475:x1875765554613760:12345-0@lo:101: Request processed in 89us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869527.282461:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788869527.282518:0:9475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82324000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554613760:0@lo:101: 00010000:00010000:2.0:1788869527.282529:0:9475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2ab4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2abb expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.282537:0:9475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2ab4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2abb expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869527.282587:0:9475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82324000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554613888:0@lo:501: 00000100:00100000:2.0:1788869527.282610:0:9475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869527.282632:0:9475:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b66240 going to sleep for 11 seconds 00000100:00100000:0.0:1788869527.282669:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554613888 00000100:00100000:0.0:1788869527.282673:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554613888 00000100:00100000:0.0:1788869527.282703:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788869527.282709:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+16:9475:x1875765554613888:12345-0@lo:501: 00000100:00100000:0.0:1788869527.282805:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+16:9475:x1875765554613888:12345-0@lo:501: Request processed in 95us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869527.282812:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788869527.282940:0:9475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82324000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554613888:0@lo:501: 00000100:00100000:2.0:1788869527.282977:0:9475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82324000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554614016:0@lo:503: 00000100:00100000:2.0:1788869527.283026:0:9475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869527.283048:0:9475:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b66240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869527.283063:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554614016 00000100:00100000:2.0:1788869527.283066:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554614016 00000100:00100000:2.0:1788869527.283086:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788869527.283092:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:9475:x1875765554614016:12345-0@lo:503: 00000100:00100000:2.0:1788869527.283165:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:9475:x1875765554614016:12345-0@lo:503: Request processed in 73us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869527.283177:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788869527.283215:0:9475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82324000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554614016:0@lo:503: 00000040:00080000:2.0:1788869527.283495:0:9475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788869527.283552:0:9475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82324000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554614144:0@lo:502: 00000100:00100000:2.0:1788869527.283595:0:9475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869527.283609:0:9475:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b66600 going to sleep for 11 seconds 00000100:00100000:2.0:1788869527.283622:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554614144 00000100:00100000:2.0:1788869527.283625:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554614144 00000100:00100000:2.0:1788869527.283641:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788869527.283647:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:9475:x1875765554614144:12345-0@lo:502: 00000100:00100000:2.0:1788869527.283712:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:9475:x1875765554614144:12345-0@lo:502: Request processed in 65us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869527.283717:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788869527.283749:0:9475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82324000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554614144:0@lo:502: 00000040:00080000:2.0:1788869527.284504:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788869527.284532:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788869527.284544:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788869527.284555:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788869527.284567:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788869527.284578:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788869527.284602:0:9475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82324000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554614272:0@lo:502: 00000100:00100000:2.0:1788869527.284643:0:9475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869527.284704:0:9475:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b66600 going to sleep for 11 seconds 00010000:00010000:1.0:1788869527.285301:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869527.285310:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2aa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbead52e175fc2aad expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.285321:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb98e3a00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1788869527.285325:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2aa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbead52e175fc2aad expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.285335:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2aa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xbead52e175fc2aad expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869527.285343:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2aa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xbead52e175fc2aad expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869527.285348:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788869527.285373:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2aa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbead52e175fc2aad expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.285379:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869527.285400:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2aa6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbead52e175fc2aad expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.285407:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2aa6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbead52e175fc2aad expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.285432:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869527.285433:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869527.285435:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869527.285505:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869527.285518:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554614400:0@lo:103: 00000100:00100000:3.0:1788869527.285555:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869527.285632:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554614400 00000100:00100000:1.0:1788869527.285638:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554614400 00000100:00100000:1.0:1788869527.285688:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869527.285696:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46892796-b77d-4866-a7cc-ce4160dea4be+16:3616:x1875765554614400:12345-0@lo:103: 00010000:00010000:1.0:1788869527.285708:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869527.285723:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb95a9400/0xbead52e175fc2aad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbead52e175fc2aa6 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.285734:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869527.285765:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46892796-b77d-4866-a7cc-ce4160dea4be+15:3616:x1875765554614400:12345-0@lo:103: Request processed in 70us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869527.285772:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869527.285873:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554614400:0@lo:103: 00000100:00100000:0.0:1788869527.286150:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554614272 00000100:00100000:0.0:1788869527.286155:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554614272 00000100:00100000:2.0:1788869527.286371:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788869527.286379:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:9475:x1875765554614272:12345-0@lo:502: 00000100:00100000:2.0:1788869527.286526:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:9475:x1875765554614272:12345-0@lo:502: Request processed in 148us (1882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869527.286540:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788869527.286596:0:9475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82324000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554614272:0@lo:502: 00000040:00080000:3.0:1788869527.286661:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788869527.286673:0:9475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1788869527.287316:0:9489:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788869527.287324:0:9489:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788869527.287330:0:9489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869527.287332:0:9489:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788869527.287337:0:9489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788869527.287358:0:9489:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99fe82cd99c0) 00000020:00000080:1.0:1788869527.287381:0:9489:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788869527.287387:0:9489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788869527.287456:0:9489:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffb9bbc800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788869527.287464:0:9489:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788869527.287470:0:9489:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbead52e175fc2ac9 00010000:00010000:1.0:1788869527.292552:0:9489:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1788869527.292897:0:9489:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788869527.295168:0:9489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788869527.295520:0:9489:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788869527.299218:0:9489:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1788869527.299580:0:9489:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1788869527.304906:0:9489:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788869527.306184:0:9489:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788869527.306195:0:9489:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869527.306202:0:9489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869527.306204:0:9489:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788869527.306207:0:9489:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869527.306211:0:9489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869527.306212:0:9489:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788869527.306215:0:9489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788869527.306217:0:9489:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788869527.306238:0:9489:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869527.306240:0:9489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869527.306242:0:9489:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788869527.306244:0:9489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788869527.306421:0:9475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788869527.306449:0:9475:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788869527.306475:0:9475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2ab4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2abb expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.306486:0:9475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2ab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2abb expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869527.306493:0:9475:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ffb9bbc800 from 1 10000000:01000000:1.0:1788869527.306496:0:9475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869527.306528:0:9475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ad0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.306536:0:9475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ad0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.306546:0:9475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ad0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869527.306567:0:9475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554614528:0@lo:101: 00000100:00100000:1.0:1788869527.306627:0:9475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869527.306664:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554614528 00000100:00100000:1.0:1788869527.306670:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554614528 00000100:00100000:1.0:1788869527.306707:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788869527.306714:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+15:9475:x1875765554614528:12345-0@lo:101: 00010000:00010000:1.0:1788869527.306725:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869527.306742:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb95a8400/0xbead52e175fc2ad7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2ad0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.306763:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb95a8400/0xbead52e175fc2ad7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2ad0 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.306772:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb95a8400/0xbead52e175fc2ad7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2ad0 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.306794:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a8400, rc 0) 00000100:00100000:1.0:1788869527.306826:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+16:9475:x1875765554614528:12345-0@lo:101: Request processed in 112us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869527.306832:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788869527.306873:0:9475:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe810dbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869527.306891:0:9475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554614528:0@lo:101: 00010000:00010000:1.0:1788869527.306903:0:9475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ad0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2ad7 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.306912:0:9475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ad0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2ad7 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869527.307003:0:9475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554614656:0@lo:501: 00000100:00100000:1.0:1788869527.307027:0:9475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869527.307041:0:9475:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe810dbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869527.307322:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554614656 00000100:00100000:3.0:1788869527.307327:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554614656 00000100:00100000:3.0:1788869527.307353:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788869527.307359:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:9475:x1875765554614656:12345-0@lo:501: 00000100:00100000:3.0:1788869527.307451:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:9475:x1875765554614656:12345-0@lo:501: Request processed in 92us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.307458:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788869527.307720:0:9475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554614656:0@lo:501: 00000100:00100000:0.0:1788869527.307750:0:9475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554614784:0@lo:503: 00000100:00100000:0.0:1788869527.307810:0:9475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869527.307835:0:9475:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b88a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869527.307885:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554614784 00000100:00100000:3.0:1788869527.307889:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554614784 00000100:00100000:3.0:1788869527.307921:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788869527.307927:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+16:9475:x1875765554614784:12345-0@lo:503: 00000100:00100000:3.0:1788869527.308014:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+16:9475:x1875765554614784:12345-0@lo:503: Request processed in 87us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.308026:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788869527.308287:0:9475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554614784:0@lo:503: 00000040:00080000:0.0:1788869527.308513:0:9475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788869527.308575:0:9475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554614912:0@lo:502: 00000100:00100000:0.0:1788869527.308611:0:9475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869527.308644:0:9475:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b88a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869527.308695:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554614912 00000100:00100000:3.0:1788869527.308699:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554614912 00000100:00100000:3.0:1788869527.308723:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788869527.308729:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+16:9475:x1875765554614912:12345-0@lo:502: 00000100:00100000:3.0:1788869527.308825:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+16:9475:x1875765554614912:12345-0@lo:502: Request processed in 95us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.308831:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788869527.308990:0:9475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554614912:0@lo:502: 00000040:00080000:0.0:1788869527.309176:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788869527.309204:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788869527.309223:0:9475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554615040:0@lo:502: 00000100:00100000:0.0:1788869527.309276:0:9475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869527.309296:0:9475:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b88a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869527.309310:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554615040 00000100:00100000:0.0:1788869527.309313:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554615040 00000100:00100000:0.0:1788869527.309335:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788869527.309342:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:9475:x1875765554615040:12345-0@lo:502: 00000100:00100000:0.0:1788869527.309414:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:9475:x1875765554615040:12345-0@lo:502: Request processed in 72us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869527.309420:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788869527.309457:0:9475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554615040:0@lo:502: 00000040:00080000:0.0:1788869527.309491:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788869527.309497:0:9475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788869527.312712:0:9492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869527.312723:0:9492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869527.312725:0:9492:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788869527.312732:0:9492:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffb9bbc800 00000020:00000080:2.0:1788869527.312735:0:9492:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788869527.312746:0:9492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869527.312748:0:9492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869527.312750:0:9492:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788869527.312753:0:9492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788869527.313429:0:9475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788869527.313461:0:9475:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869527.313486:0:9475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ad0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2ad7 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.313499:0:9475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ad0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2ad7 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869527.313555:0:9475:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788869527.313559:0:9475:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ffb9bbc800 10000000:01000000:1.0:1788869527.313562:0:9475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ffb9bbc800 10000000:01000000:1.0:1788869527.313566:0:9475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788869527.313573:0:9475:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ffb9bbc800 from 1 10000000:01000000:1.0:1788869527.313575:0:9475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788869527.313616:0:9475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9000/0xbead52e175fc2ade lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.313624:0:9475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9000/0xbead52e175fc2ade lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.313635:0:9475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9000/0xbead52e175fc2ade lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869527.313656:0:9475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e07100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554615168:0@lo:101: 00000100:00100000:1.0:1788869527.313721:0:9475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869527.313756:0:9475:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe810dbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869527.313924:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554615168 00000100:00100000:3.0:1788869527.313932:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554615168 00000100:00100000:3.0:1788869527.313993:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788869527.314002:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:9475:x1875765554615168:12345-0@lo:101: 00010000:00010000:3.0:1788869527.314014:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869527.314027:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2ae5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2ade expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.314049:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2ade expref: 17 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.314060:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2ade expref: 17 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.314068:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9f200, rc 0) 00000100:00100000:3.0:1788869527.314118:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+17:9475:x1875765554615168:12345-0@lo:101: Request processed in 117us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.314125:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788869527.314204:0:9475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e07100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554615168:0@lo:101: 00010000:00010000:0.0:1788869527.314221:0:9475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9000/0xbead52e175fc2ade lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2ae5 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869527.314242:0:9475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9000/0xbead52e175fc2ade lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2ae5 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869527.314355:0:9475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554615296:0@lo:501: 00000100:00100000:0.0:1788869527.314384:0:9475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869527.314400:0:9475:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b88a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869527.314448:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554615296 00000100:00100000:3.0:1788869527.314452:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554615296 00000100:00100000:3.0:1788869527.314489:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788869527.314495:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:9475:x1875765554615296:12345-0@lo:501: 00000100:00100000:3.0:1788869527.314584:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:9475:x1875765554615296:12345-0@lo:501: Request processed in 89us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.314592:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788869527.314623:0:9475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554615296:0@lo:501: 00000100:00100000:3.0:1788869527.314649:0:9475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554615424:0@lo:503: 00000100:00100000:3.0:1788869527.314685:0:9475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869527.314704:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554615424 00000100:00100000:3.0:1788869527.314707:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554615424 00000100:00100000:3.0:1788869527.314724:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788869527.314729:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:9475:x1875765554615424:12345-0@lo:503: 00000100:00100000:3.0:1788869527.314896:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:9475:x1875765554615424:12345-0@lo:503: Request processed in 166us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.314903:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788869527.314932:0:9475:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869527.314943:0:9475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554615424:0@lo:503: 00000040:00080000:3.0:1788869527.315228:0:9475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788869527.315382:0:9475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554615552:0@lo:502: 00000100:00100000:3.0:1788869527.315416:0:9475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869527.315475:0:9475:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869527.317711:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554615552 00000100:00100000:0.0:1788869527.317723:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554615552 00000100:00100000:3.0:1788869527.318157:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788869527.318168:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+17:9475:x1875765554615552:12345-0@lo:502: 00000100:00100000:3.0:1788869527.318357:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+17:9475:x1875765554615552:12345-0@lo:502: Request processed in 191us (2939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.318372:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788869527.318430:0:9475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554615552:0@lo:502: 00000040:00080000:3.0:1788869527.318661:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788869527.318689:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788869527.318701:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788869527.318713:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788869527.318725:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788869527.318738:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788869527.318751:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788869527.318762:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788869527.318774:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788869527.318919:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788869527.318934:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788869527.318945:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788869527.318958:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788869527.318971:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788869527.318999:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788869527.319013:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788869527.319024:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788869527.319036:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788869527.319047:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788869527.319059:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788869527.319072:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788869527.319083:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788869527.319095:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788869527.319109:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788869527.319121:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788869527.319132:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788869527.319144:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788869527.319158:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788869527.319170:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788869527.319194:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1788869527.319207:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1788869527.319219:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1788869527.319229:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1788869527.319240:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1788869527.319428:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1788869527.319448:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1788869527.319462:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1788869527.319476:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788869527.319489:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1788869527.319500:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1788869527.319514:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1788869527.319527:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1788869527.319541:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1788869527.319554:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1788869527.319570:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1788869527.319582:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1788869527.319617:0:9475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554615680:0@lo:502: 00000100:00100000:3.0:1788869527.319671:0:9475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869527.319745:0:9475:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869527.321574:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554615680 00000100:00100000:1.0:1788869527.321586:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554615680 00000100:00100000:1.0:1788869527.321639:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788869527.321648:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+17:9475:x1875765554615680:12345-0@lo:502: 00000100:00100000:1.0:1788869527.321921:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+17:9475:x1875765554615680:12345-0@lo:502: Request processed in 273us (2248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869527.321929:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788869527.322050:0:9475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554615680:0@lo:502: 00000040:00080000:2.0:1788869527.322127:0:9475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1788869527.322141:0:9475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1788869527.322688:0:9494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788869527.322704:0:9494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99fe82cdb380) 00000020:00000080:1.0:1788869527.322727:0:9494:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1788869527.323574:0:9494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffb9bbc800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788869527.323579:0:9494:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffb9bbc800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788869527.323582:0:9494:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffb9bbc800 3 00010000:00080000:1.0:1788869527.323611:0:9494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fe82ef7000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.130@tcp at head 00010000:00010000:1.0:1788869527.327559:0:9494:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1788869527.327659:0:9494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788869527.327701:0:9494:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788869527.327713:0:9494:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbead52e175fc2af3 00000100:00080000:1.0:1788869527.327722:0:9494:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788869527.327727:0:9494:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99fe82ef7000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1788869527.327758:0:9494:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffb9e05c00 x1875765554615808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788869527.328897:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3615:1875765554615808:0@lo:38: 00000100:00100000:2.0:1788869527.328966:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869527.329054:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554615808 00000100:00100000:0.0:1788869527.329061:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554615808 00000100:00100000:0.0:1788869527.329094:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869527.329101:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1875765554615808:12345-0@lo:38: 00010000:00080000:0.0:1788869527.329125:0:6486:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:0.0:1788869527.329157:0:6486:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbead52e175fc2afa 00000004:00100000:0.0:1788869527.329171:0:6486:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788869527.329196:0:6486:0:(import.c:65:import_set_state_nolock()) ffff99fe81f35000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788869527.329264:0:9494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788869527.329345:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554616064:0@lo:400: 00000100:00100000:1.0:1788869527.329372:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869527.329388:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554616576:0@lo:400: 00000100:00100000:1.0:1788869527.329403:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869527.329416:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788869527.329421:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554615936:0@lo:400: 00000100:00100000:1.0:1788869527.329434:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869527.329441:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554616448:0@lo:400: 00000100:00100000:1.0:1788869527.329467:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869527.329484:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554616192:0@lo:400: 00000100:00100000:1.0:1788869527.329501:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869527.329508:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554616704:0@lo:400: 00000100:00100000:1.0:1788869527.329523:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869527.329543:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788869527.329548:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554616320:0@lo:400: 00000100:00100000:1.0:1788869527.329564:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869527.329575:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554616832:0@lo:400: 00000100:00100000:1.0:1788869527.329599:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869527.329619:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554616064 00000100:00100000:1.0:1788869527.329623:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554616064 00000100:00100000:1.0:1788869527.329645:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554616320 00000100:00100000:1.0:1788869527.329647:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554616320 00000100:00100000:1.0:1788869527.329657:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788869527.329662:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554616064:12345-0@lo:400: 00000100:00100000:1.0:1788869527.329694:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554616064:12345-0@lo:400: Request processed in 31us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869527.329699:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788869527.329712:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788869527.329716:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554616320:12345-0@lo:400: 00000100:00100000:1.0:1788869527.329735:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554616320:12345-0@lo:400: Request processed in 19us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869527.329740:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788869527.329753:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554616704 00000100:00100000:1.0:1788869527.329755:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554616704 00000100:00100000:3.0:1788869527.330506:0:6484:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788869527.330514:0:6484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788869527.330699:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554616832 00000100:00100000:1.0:1788869527.330704:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554616832 00000100:00100000:1.0:1788869527.330732:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869527.330737:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554616704:12345-0@lo:400: 00000100:00100000:1.0:1788869527.330790:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554616704:12345-0@lo:400: Request processed in 52us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869527.330795:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869527.330811:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869527.330816:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554616832:12345-0@lo:400: 00000100:00100000:1.0:1788869527.330838:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554616832:12345-0@lo:400: Request processed in 23us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869527.330843:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788869527.330861:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869527.330892:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554616320:0@lo:400: 00010000:00080000:1.0:1788869527.330903:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffb9e06d80 x1875765554616832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869527.330912:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554616832:0@lo:400: 00010000:00080000:1.0:1788869527.330919:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffb9e05880 x1875765554616704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869527.330926:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554616704:0@lo:400: 00000100:00100000:1.0:1788869527.330952:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554616064:0@lo:400: 00000020:01000004:1.0:1788869527.331279:0:9494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788869527.331293:0:9494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff99fe82cdcd40) 00000020:00000080:1.0:1788869527.331314:0:9494:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1788869527.333662:0:9494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffb9bbc800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788869527.333671:0:9494:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffb9bbc800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788869527.333674:0:9494:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffb9bbc800 3 00010000:00080000:1.0:1788869527.333711:0:9494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fe83094000@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.130@tcp at head 00000100:00080000:3.0:1788869527.333958:0:9497:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff99fe82cb6d80 x1875765554616960/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869527.333970:0:9497:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f2240 going to sleep for 0 seconds 00000100:00100000:3.0:1788869527.337918:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788869527.337941:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554616576 00000100:00100000:3.0:1788869527.337949:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554616576 00000100:00100000:3.0:1788869527.338016:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788869527.338021:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554615936 00000100:00100000:3.0:1788869527.338024:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554615936 00000100:00100000:3.0:1788869527.338035:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788869527.338046:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554616448 00000100:00100000:3.0:1788869527.338049:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554616448 00000100:00100000:3.0:1788869527.338063:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788869527.338066:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554616192 00000100:00100000:3.0:1788869527.338068:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554616192 00000100:00100000:3.0:1788869527.338078:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788869527.338087:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788869527.338095:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875765554616576:12345-0@lo:400: 00000100:00100000:3.0:1788869527.338182:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875765554616576:12345-0@lo:400: Request processed in 87us (8777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.338189:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788869527.338203:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788869527.338209:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788869527.338214:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554615936:12345-0@lo:400: 00000100:00100000:3.0:1788869527.338242:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554615936:12345-0@lo:400: Request processed in 28us (8806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.338247:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788869527.338333:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875765554615808:12345-0@lo:38: Request processed in 9229us (9364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869527.338341:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869527.338358:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788869527.338365:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554616448:12345-0@lo:400: 00000100:00100000:0.0:1788869527.338394:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554616448:12345-0@lo:400: Request processed in 31us (8927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869527.338399:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788869527.338410:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788869527.338416:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554616192:12345-0@lo:400: 00000100:00100000:0.0:1788869527.338458:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554616192:12345-0@lo:400: Request processed in 42us (8956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869527.338463:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788869527.338566:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffb9e05c00 x1875765554615808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869527.338578:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788869527.338595:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788869527.338603:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788869527.338607:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788869527.338611:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99fe82ef7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788869527.338618:0:3615:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000369fabf2): req@ffff99fe82cb6d80 x1875765554616960/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869527.338649:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3615:1875765554615808:0@lo:38: 00000100:00100000:0.0:1788869527.338876:0:9497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869527.338903:0:9497:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f2240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869527.338948:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554616960 00000100:00100000:2.0:1788869527.338953:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554616960 00000100:00080000:1.0:1788869527.339048:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869527.339052:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788869527.339075:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffb9e06300 x1875765554615936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869527.339085:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554615936:0@lo:400: 00010000:00080000:1.0:1788869527.339104:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffb9e07800 x1875765554616448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869527.339112:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554616448:0@lo:400: 00010000:00080000:1.0:1788869527.339122:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffb9e05180 x1875765554616576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869527.339129:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554616576:0@lo:400: 00010000:00080000:1.0:1788869527.339157:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffb9e04380 x1875765554616192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869527.339165:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554616192:0@lo:400: 00000100:00100000:2.0:1788869527.339991:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869527.340002:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9497:x1875765554616960:12345-0@lo:901: 00000100:00100000:2.0:1788869527.340133:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9497:x1875765554616960:12345-0@lo:901: Request processed in 133us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869527.340139:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788869527.340219:0:9494:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:1.0:1788869527.341058:0:9494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788869527.341111:0:9494:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788869527.341126:0:9494:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xbead52e175fc2b08 00000100:00080000:1.0:1788869527.341133:0:9494:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788869527.341138:0:9494:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff99fe83094000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1788869527.341168:0:9494:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe83084000 x1875765554617088/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869527.341213:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3615:1875765554617088:0@lo:38: 00000100:00100000:1.0:1788869527.341306:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869527.341360:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554617088 00000100:00100000:1.0:1788869527.341367:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554617088 00000100:00100000:1.0:1788869527.341393:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788869527.341399:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1875765554617088:12345-0@lo:38: 00010000:00080000:1.0:1788869527.341420:0:6486:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:1.0:1788869527.341455:0:6486:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xbead52e175fc2b0f 00000004:00100000:1.0:1788869527.341470:0:6486:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788869527.341497:0:6486:0:(import.c:65:import_set_state_nolock()) ffff99fe83092800 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1788869527.341622:0:9497:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe82cb6d80 x1875765554616960/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788869543 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869527.341635:0:9497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb6d80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9497:1875765554616960:0@lo:901: 00000100:00100000:1.0:1788869527.341873:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875765554617088:12345-0@lo:38: Request processed in 139us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869527.341882:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788869527.341916:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe83084000 x1875765554617088/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869527.341924:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788869527.341929:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788869527.341936:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788869527.341940:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788869527.341943:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99fe83094000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788869527.341948:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3615:1875765554617088:0@lo:38: 00000100:00080000:1.0:1788869527.341961:0:9494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1788869527.343962:0:9494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1788869527.344147:0:9475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1788869527.344180:0:9475:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788869527.344247:0:9475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9000/0xbead52e175fc2ade lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2ae5 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869527.344284:0:9475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9000/0xbead52e175fc2ade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2ae5 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788869527.344331:0:9475:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788869527.344333:0:9475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788869527.344335:0:9475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869527.344336:0:9475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869527.344337:0:9475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869527.344338:0:9475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869527.344340:0:9475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869527.344341:0:9475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788869527.344343:0:9475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788869527.344344:0:9475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869527.344346:0:9475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788869527.344349:0:9475:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788869527.344352:0:9475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788869527.344354:0:9475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788869527.344355:0:9475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869527.344356:0:9475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869527.344357:0:9475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869527.344358:0:9475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869527.344359:0:9475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869527.344361:0:9475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788869527.344362:0:9475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788869527.344363:0:9475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869527.344368:0:9475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788869527.344395:0:9475:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788869527.344413:0:9475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82324700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554617216:0@lo:253: 00000100:00100000:2.0:1788869527.344476:0:9475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869527.344509:0:9475:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869527.344527:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554617216 00000100:00100000:2.0:1788869527.344532:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554617216 00000100:00100000:2.0:1788869527.344574:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788869527.344583:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:9475:x1875765554617216:12345-0@lo:253: 20000000:01000000:2.0:1788869527.344609:0:6478:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788869527.344623:0:6478:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788869527.355060:0:6478:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788869527.355109:0:6478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788869527.355459:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:9475:x1875765554617216:12345-0@lo:253: Request processed in 10872us (10978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.355471:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788869527.355619:0:9475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82324700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:46892796-b77d-4866-a7cc-ce4160dea4be:9475:1875765554617216:0@lo:253: 10000000:01000000:0.0:1788869527.355634:0:9475:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788869527.355637:0:9475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788869527.355639:0:9475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788869527.355641:0:9475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788869527.355642:0:9475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788869527.355644:0:9475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788869527.355645:0:9475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788869527.355647:0:9475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788869527.355648:0:9475:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788869527.355650:0:9475:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788869527.355652:0:9475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788869527.355653:0:9475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788869527.355670:0:9475:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788869527.357386:0:6500:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788869527.357393:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788869527.357419:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffb95a9c00/0xbead52e175fc2b16 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.357818:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb98e2200/0xbead52e175fc2a0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2a05 expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.357828:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2a52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2a4b expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.357836:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffb95a9c00/0xbead52e175fc2b16 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.357895:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2a4b expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.357912:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2a52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2a4b expref: 16 pid: 6478 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869527.357927:0:6500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83084000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1875765554617344:0@lo:104: 00000100:00100000:1.0:1788869527.357998:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788869527.358096:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb98e2200/0xbead52e175fc2a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2a05 expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.358105:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffb98e2200/0xbead52e175fc2a0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2a05 expref: 16 pid: 6478 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869527.358113:0:6500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83087100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1875765554617472:0@lo:104: 00000100:00100000:1.0:1788869527.358134:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:2.0:1788869527.360350:0:9475:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788869527.360524:0:9475:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788869527.360700:0:9475:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788869527.360845:0:9475:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788869527.363542:0:9475:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788869527.363750:0:9475:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:1.0:1788869527.364327:0:6500:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe810db780 going to sleep for 11 seconds 00000001:00000004:0.0:1788869527.365376:0:9475:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788869527.370139:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554617344 00000100:00100000:3.0:1788869527.370153:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554617344 00000100:00100000:3.0:1788869527.370660:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554617472 00000100:00100000:3.0:1788869527.370666:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554617472 00000100:00100000:3.0:1788869527.370702:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788869527.370712:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83087480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+4:6500:x1875765554617344:12345-0@lo:104: 00010000:00010000:3.0:1788869527.370729:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2a52 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.370836:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788869527.370843:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83087480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+4:6500:x1875765554617344:12345-0@lo:104: Request processed in 134us (12845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.370849:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788869527.370867:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788869527.370873:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+3:6500:x1875765554617472:12345-0@lo:104: 00010000:00010000:3.0:1788869527.370881:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ff80030a00/0xbead52e175fc2a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2a0c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.370914:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788869527.370919:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+3:6500:x1875765554617472:12345-0@lo:104: Request processed in 47us (12784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.370924:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788869527.370941:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869527.370946:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2a52 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.370953:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9ee00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1788869527.370957:0:7425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2a52 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.370965:0:7425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2a4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2a52 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869527.370997:0:7425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2a4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2a52 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869527.371004:0:7425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788869527.371041:0:7425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2a4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2a52 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.371048:0:7425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869527.371064:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2a4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2a52 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.371070:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2a4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2a52 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.371081:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869527.371084:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ff80030a00/0xbead52e175fc2a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2a0c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.371089:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80030a00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1788869527.371092:0:7425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ff80030a00/0xbead52e175fc2a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2a0c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.371098:0:7425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ff80030a00/0xbead52e175fc2a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2a0c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869527.371103:0:7425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ff80030a00/0xbead52e175fc2a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2a0c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869527.371108:0:7425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788869527.371127:0:7425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ff80030a00/0xbead52e175fc2a05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2a0c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.371133:0:7425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869527.371138:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ff80030a00/0xbead52e175fc2a05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2a0c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.371143:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ff80030a00/0xbead52e175fc2a05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2a0c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.371157:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869527.371159:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869527.371160:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869527.371166:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869527.371184:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554617600:0@lo:103: 00000100:00100000:3.0:1788869527.371221:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869527.371274:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869527.371280:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554617728:0@lo:103: 00000100:00100000:3.0:1788869527.371301:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869527.371325:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554617600 00000100:00100000:3.0:1788869527.371329:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554617600 00010000:00010000:3.0:1788869527.371346:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2a52 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2a4b expref: 17 pid: 6478 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869527.371369:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554617728 00000100:00100000:3.0:1788869527.371372:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554617728 00010000:00010000:3.0:1788869527.371383:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb98e2200/0xbead52e175fc2a0c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2a05 expref: 18 pid: 6478 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869527.371399:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788869527.371406:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+18:3618:x1875765554617600:12345-0@lo:103: 00010000:00010000:3.0:1788869527.371423:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869527.371430:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2a52 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2a4b expref: 18 pid: 6478 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.371441:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2a52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2a4b expref: 18 pid: 6478 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.371461:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869527.371487:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+18:3618:x1875765554617600:12345-0@lo:103: Request processed in 82us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.371493:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788869527.371505:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788869527.371510:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+17:3618:x1875765554617728:12345-0@lo:103: 00010000:00010000:3.0:1788869527.371516:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869527.371520:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb98e2200/0xbead52e175fc2a0c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2a05 expref: 17 pid: 6478 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.371528:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb98e2200/0xbead52e175fc2a0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2a05 expref: 17 pid: 6478 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.371539:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffb95a9c00/0xbead52e175fc2b16 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.371546:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb95a9c00/0xbead52e175fc2b16 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788869527.371560:0:6470:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014166616s 00010000:00010000:3.0:1788869527.371564:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffb95a9c00/0xbead52e175fc2b16 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.371581:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffb95a9c00/0xbead52e175fc2b16 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.371587:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffb95a9c00/0xbead52e175fc2b16 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.371594:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffb95a9c00/0xbead52e175fc2b16 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.371599:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a9c00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869527.371602:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffb95a9c00/0xbead52e175fc2b16 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.371608:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffb95a9c00/0xbead52e175fc2b16 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.371616:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffb95a9c00/0xbead52e175fc2b16 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869527.371626:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869527.371649:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+17:3618:x1875765554617728:12345-0@lo:103: Request processed in 139us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869527.371654:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788869527.371689:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554617728:0@lo:103: 00000100:00100000:3.0:1788869527.371697:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554617600:0@lo:103: 00010000:00010000:1.0:1788869527.371859:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2a52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2a4b expref: 16 pid: 6478 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869527.371871:0:6500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83084000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1875765554617344:0@lo:104: 00010000:00010000:1.0:1788869527.371880:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb98e2200/0xbead52e175fc2a0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2a05 expref: 15 pid: 6478 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869527.371887:0:6500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83087100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1875765554617472:0@lo:104: 00010000:00010000:1.0:1788869527.371901:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffb95a9c00/0xbead52e175fc2b16 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.371919:0:6500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffb95a9c00/0xbead52e175fc2b16 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.371926:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffb95a9c00/0xbead52e175fc2b16 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869527.371932:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb95a9c00/0xbead52e175fc2b16 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788869527.373911:0:9475:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788869527.373920:0:9475:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788869527.373957:0:9475:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788869527.374011:0:9475:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788869527.374030:0:9475:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788869527.374049:0:9475:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788869527.377295:0:9475:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869527.377503:0:9475:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788869527.449410:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869528.473346:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788869528.485173:0:9552:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788869528.486168:0:9552:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788869529.497894:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554617856:0@lo:13: 00000100:00100000:0.0:1788869529.497976:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869529.498046:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554617856 00000100:00100000:0.0:1788869529.498054:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554617856 00000100:00100000:0.0:1788869529.498106:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788869529.498123:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554617856:12345-0@lo:13: 00002000:00000024:0.0:1788869529.498150:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869529.498194:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554617856:12345-0@lo:13: Request processed in 73us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869529.498202:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788869529.498223:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788869529.498269:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe81c8ca80 x1875765554617856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869529.498289:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554617856:0@lo:13: 00010000:00010000:0.0:1788869529.498944:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869529.504041:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554617984:0@lo:13: 00000100:00100000:1.0:1788869529.504108:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869529.508622:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554617984 00000100:00100000:3.0:1788869529.508642:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554617984 00000100:00100000:3.0:1788869529.508719:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869529.508826:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554617984:12345-0@lo:13: 00002000:00000024:3.0:1788869529.508851:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869529.508920:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554617984:12345-0@lo:13: Request processed in 97us (4811us total) trans 0 rc 0/0 00000100:00080000:0.0:1788869529.508962:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869529.509875:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788869529.509943:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82cb6d80 x1875765554617984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869529.509967:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554617984:0@lo:13: 00000100:00100000:1.0:1788869530.008543:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869530.008570:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554618112:0@lo:41: 00000100:00100000:1.0:1788869530.008642:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869530.008668:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554618112 00000100:00100000:0.0:1788869530.008677:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554618112 00000100:00100000:0.0:1788869530.008739:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788869530.008748:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554618112:12345-0@lo:41: 00000004:00000024:0.0:1788869530.008781:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788869530.008835:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554618112:12345-0@lo:41: Request processed in 88us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869530.008842:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788869530.008914:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554618112:0@lo:41: 00010000:00010000:1.0:1788869530.526969:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869531.546328:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869531.546530:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554618240:0@lo:41: 00000100:00100000:1.0:1788869531.546596:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869531.546782:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554618240 00000100:00100000:3.0:1788869531.546790:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554618240 00000100:00100000:3.0:1788869531.546836:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788869531.546845:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554618240:12345-0@lo:41: 00000004:00000024:3.0:1788869531.548736:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1788869531.548821:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554618240:12345-0@lo:41: Request processed in 1975us (2222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869531.548830:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788869531.549828:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554618240:0@lo:41: 00000100:00100000:3.0:1788869532.569909:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554618368:0@lo:400: 00000100:00100000:3.0:1788869532.569983:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869532.570028:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554618880:0@lo:400: 00000100:00100000:3.0:1788869532.570056:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869532.570076:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554619392:0@lo:400: 00000100:00100000:3.0:1788869532.570099:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869532.570136:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788869532.570142:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554618496:0@lo:400: 00000100:00100000:3.0:1788869532.570181:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869532.570204:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875765554619008:0@lo:400: 00000100:00100000:3.0:1788869532.570226:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869532.570243:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875765554619520:0@lo:400: 00000100:00100000:3.0:1788869532.570287:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869532.570313:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554618624:0@lo:400: 00000100:00100000:3.0:1788869532.570333:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869532.570348:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554619136:0@lo:400: 00000100:00100000:3.0:1788869532.570365:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869532.570385:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875765554619648:0@lo:400: 00000100:00100000:3.0:1788869532.570408:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869532.570418:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788869532.570423:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554618752:0@lo:400: 00000100:00100000:3.0:1788869532.570455:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869532.570467:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554619264:0@lo:400: 00000100:00100000:3.0:1788869532.570486:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869532.570515:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869532.570526:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554618880 00000100:00100000:3.0:1788869532.570533:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554618880 00000100:00100000:3.0:1788869532.570568:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554618624 00000100:00100000:3.0:1788869532.570571:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554618624 00000100:00100000:3.0:1788869532.570587:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788869532.570595:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554618880:12345-0@lo:400: 00000100:00100000:3.0:1788869532.570649:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554618880:12345-0@lo:400: Request processed in 54us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869532.570662:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788869532.570679:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788869532.570686:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554618624:12345-0@lo:400: 00000100:00100000:3.0:1788869532.570720:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554618624:12345-0@lo:400: Request processed in 34us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869532.570726:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788869532.570744:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554619392 00000100:00100000:3.0:1788869532.570747:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554619392 00000100:00100000:3.0:1788869532.570778:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554619264 00000100:00100000:3.0:1788869532.570781:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554619264 00000100:00100000:3.0:1788869532.570801:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788869532.570808:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554619392:12345-0@lo:400: 00000100:00100000:3.0:1788869532.570839:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554619392:12345-0@lo:400: Request processed in 31us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869532.570844:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788869532.570855:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788869532.570861:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554619264:12345-0@lo:400: 00000100:00100000:3.0:1788869532.570900:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554619264:12345-0@lo:400: Request processed in 39us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869532.570906:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788869532.570924:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554618496 00000100:00100000:3.0:1788869532.570927:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554618496 00000100:00100000:3.0:1788869532.570944:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554619008 00000100:00100000:3.0:1788869532.570946:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554619008 00000100:00100000:3.0:1788869532.570956:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554619520 00000100:00100000:3.0:1788869532.570958:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554619520 00000100:00100000:3.0:1788869532.570968:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554619136 00000100:00100000:3.0:1788869532.570970:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554619136 00000100:00100000:3.0:1788869532.570990:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554619648 00000100:00100000:3.0:1788869532.570993:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554619648 00000100:00100000:3.0:1788869532.571001:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554618752 00000100:00100000:3.0:1788869532.571003:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554618752 00000100:00100000:3.0:1788869532.571012:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788869532.571017:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554618496:12345-0@lo:400: 00000100:00100000:3.0:1788869532.571047:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554618496:12345-0@lo:400: Request processed in 29us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869532.571053:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788869532.571064:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788869532.571069:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875765554619008:12345-0@lo:400: 00000100:00100000:3.0:1788869532.571090:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875765554619008:12345-0@lo:400: Request processed in 22us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869532.571093:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788869532.571100:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788869532.571103:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875765554619520:12345-0@lo:400: 00000100:00100000:3.0:1788869532.571115:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875765554619520:12345-0@lo:400: Request processed in 13us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869532.571119:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788869532.571124:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788869532.571127:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554619136:12345-0@lo:400: 00000100:00100000:3.0:1788869532.571139:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554619136:12345-0@lo:400: Request processed in 12us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869532.571142:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788869532.571148:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788869532.571151:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875765554619648:12345-0@lo:400: 00000100:00100000:3.0:1788869532.571162:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875765554619648:12345-0@lo:400: Request processed in 11us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869532.571171:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788869532.571178:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788869532.571181:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554618752:12345-0@lo:400: 00000100:00100000:3.0:1788869532.571199:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554618752:12345-0@lo:400: Request processed in 17us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869532.571202:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788869532.571248:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82cb4a80 x1875765554618496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869532.571284:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554618496:0@lo:400: 00010000:00080000:3.0:1788869532.571295:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82cb5c00 x1875765554619008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869532.571300:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875765554619008:0@lo:400: 00010000:00080000:3.0:1788869532.571306:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82cb7b80 x1875765554619520/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869532.571311:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875765554619520:0@lo:400: 00000100:00100000:3.0:1788869532.571317:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554618880:0@lo:400: 00010000:00080000:3.0:1788869532.571321:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82cb4380 x1875765554619392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869532.571326:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554619392:0@lo:400: 00010000:00080000:3.0:1788869532.571349:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82cb7480 x1875765554618752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869532.571354:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554618752:0@lo:400: 00010000:00080000:3.0:1788869532.571372:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82cb5500 x1875765554619264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869532.571380:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554619264:0@lo:400: 00000100:00100000:3.0:1788869532.571389:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554618624:0@lo:400: 00010000:00080000:3.0:1788869532.571396:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82cb6300 x1875765554619136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869532.571403:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554619136:0@lo:400: 00010000:00080000:3.0:1788869532.571411:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82cb7800 x1875765554619648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869532.571418:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875765554619648:0@lo:400: 00000100:00080000:3.0:1788869532.571440:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869532.571444:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869532.571446:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869532.573117:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554618368 00000100:00100000:1.0:1788869532.573129:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554618368 00000100:00100000:1.0:1788869532.573178:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788869532.573188:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:3616:x1875765554618368:12345-0@lo:400: 00000100:00100000:1.0:1788869532.573278:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:3616:x1875765554618368:12345-0@lo:400: Request processed in 91us (3294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869532.573285:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788869532.573403:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554618368:0@lo:400: 00010000:00010000:1.0:1788869533.603924:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788869533.971777:0:9841:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788869534.616452:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554619776:0@lo:13: 00000100:00100000:1.0:1788869534.616528:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869534.616609:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554619776 00000100:00100000:1.0:1788869534.616616:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554619776 00000100:00100000:2.0:1788869534.621727:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869534.621753:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554619904:0@lo:13: 00000100:00100000:2.0:1788869534.621841:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869534.622014:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554619904 00000100:00100000:1.0:1788869534.622022:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554619904 00000100:00100000:1.0:1788869534.622051:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788869534.622059:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554619776:12345-0@lo:13: 00002000:00000024:1.0:1788869534.622089:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869534.625055:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554619776:12345-0@lo:13: Request processed in 2987us (8518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869534.625067:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788869534.625111:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788869534.625124:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554619904:12345-0@lo:13: 00002000:00000024:1.0:1788869534.625149:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869534.625179:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554619904:12345-0@lo:13: Request processed in 61us (3339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869534.625186:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788869534.625233:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe81c8ca80 x1875765554619776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869534.625268:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554619776:0@lo:13: 00010000:00080000:2.0:1788869534.626980:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82327100 x1875765554619904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869534.627009:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554619904:0@lo:13: 00000100:00080000:3.0:1788869534.627156:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788869534.627489:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869535.136235:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554620032:0@lo:41: 00000100:00100000:3.0:1788869535.136319:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869535.136366:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554620032 00000100:00100000:1.0:1788869535.136376:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554620032 00000100:00100000:1.0:1788869535.136427:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788869535.136437:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554620032:12345-0@lo:41: 00000004:00000024:1.0:1788869535.136471:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788869535.136746:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554620032:12345-0@lo:41: Request processed in 309us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869535.136754:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788869535.140509:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554620032:0@lo:41: 00000020:00000004:1.0:1788869535.190338:0:9894:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788869535.190588:0:9894:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788869535.640403:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869536.664513:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869536.668778:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554620160:0@lo:41: 00000100:00100000:3.0:1788869536.668865:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869536.669557:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554620160 00000100:00100000:2.0:1788869536.669567:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554620160 00000100:00100000:2.0:1788869536.669636:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788869536.669648:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554620160:12345-0@lo:41: 00000004:00000024:2.0:1788869536.669696:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1788869536.669772:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554620160:12345-0@lo:41: Request processed in 126us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869536.669790:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788869536.670039:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554620160:0@lo:41: 10000000:01000000:3.0:1788869537.176667:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788869537.176675:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ffc10cf800 from 39 10000000:01000000:3.0:1788869537.176680:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788869537.176725:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2b1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.177048:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2b1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.177060:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2b1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869537.177087:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554620288:0@lo:101: 00000100:00100000:3.0:1788869537.177159:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869537.177432:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554620288 00000100:00100000:2.0:1788869537.177440:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554620288 00000100:00100000:2.0:1788869537.177501:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788869537.177511:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+15:6481:x1875765554620288:12345-0@lo:101: 00010000:00010000:2.0:1788869537.177524:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869537.177603:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff81534800/0xbead52e175fc2b24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2b1d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.177626:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff81534800/0xbead52e175fc2b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2b1d expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.177636:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff81534800/0xbead52e175fc2b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2b1d expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.177646:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534800, rc 0) 00000100:00100000:2.0:1788869537.177680:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+16:6481:x1875765554620288:12345-0@lo:101: Request processed in 171us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869537.177687:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788869537.178171:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869537.178198:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554620288:0@lo:101: 00010000:00010000:3.0:1788869537.178217:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2b1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2b24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.178228:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2b1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2b24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869537.178306:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554620416:0@lo:501: 00000100:00100000:3.0:1788869537.178340:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869537.178438:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554620416 00000100:00100000:1.0:1788869537.178444:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554620416 00000100:00100000:1.0:1788869537.179872:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788869537.179891:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:6481:x1875765554620416:12345-0@lo:501: 00000100:00100000:1.0:1788869537.180060:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:6481:x1875765554620416:12345-0@lo:501: Request processed in 176us (1718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869537.180068:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788869537.191927:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869537.191978:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554620416:0@lo:501: 00000100:00100000:3.0:1788869537.192049:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554620544:0@lo:503: 00000100:00100000:3.0:1788869537.192132:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869537.192232:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869537.193687:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554620544 00000100:00100000:0.0:1788869537.193699:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554620544 00000100:00100000:0.0:1788869537.193830:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788869537.193842:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+16:6481:x1875765554620544:12345-0@lo:503: 00000100:00100000:0.0:1788869537.194063:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+16:6481:x1875765554620544:12345-0@lo:503: Request processed in 223us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.194071:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788869537.194157:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554620544:0@lo:503: 00000100:00100000:1.0:1788869537.194477:0:9946:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83084380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9946:1875765554620672:0@lo:502: 00000100:00100000:1.0:1788869537.194521:0:9946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869537.194562:0:9946:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84fad900 going to sleep for 11 seconds 00000100:00100000:2.0:1788869537.194612:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554620672 00000100:00100000:2.0:1788869537.194617:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554620672 00000100:00100000:2.0:1788869537.194652:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788869537.194659:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:9946:x1875765554620672:12345-0@lo:502: 00000100:00100000:2.0:1788869537.194754:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:9946:x1875765554620672:12345-0@lo:502: Request processed in 96us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869537.194781:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788869537.194864:0:9946:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83084380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9946:1875765554620672:0@lo:502: 00000100:00100000:0.0:1788869537.194906:0:9946:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9946:1875765554620800:0@lo:502: 00000100:00100000:0.0:1788869537.194940:0:9946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869537.194965:0:9946:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869537.195170:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554620800 00000100:00100000:1.0:1788869537.195175:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554620800 00000100:00100000:1.0:1788869537.195215:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788869537.195222:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+16:9946:x1875765554620800:12345-0@lo:502: 00000100:00100000:1.0:1788869537.195327:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+16:9946:x1875765554620800:12345-0@lo:502: Request processed in 105us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869537.195334:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788869537.195409:0:9946:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9946:1875765554620800:0@lo:502: 00000040:00080000:0.0:1788869537.195427:0:9946:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1788869537.195581:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788869537.195602:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788869537.195611:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2b1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2b24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869537.195633:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2b24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869537.195642:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788869537.195645:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788869537.195648:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788869537.195672:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2b2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869537.195680:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2b2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869537.195690:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2b2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869537.195703:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83087b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554620928:0@lo:101: 00000100:00100000:1.0:1788869537.195729:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869537.195761:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84fad0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869537.195814:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554620928 00000100:00100000:0.0:1788869537.195818:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554620928 00000100:00100000:0.0:1788869537.195836:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788869537.195842:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+16:6481:x1875765554620928:12345-0@lo:101: 00010000:00010000:0.0:1788869537.195850:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869537.195862:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb98e3600/0xbead52e175fc2b32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2b2b expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.195884:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb98e3600/0xbead52e175fc2b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2b2b expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.195895:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb98e3600/0xbead52e175fc2b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2b2b expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.195903:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb98e3600, rc 0) 00000100:00100000:0.0:1788869537.195944:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554620928:12345-0@lo:101: Request processed in 101us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.195950:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788869537.196236:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83087b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554620928:0@lo:101: 00010000:00010000:1.0:1788869537.196249:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2b2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2b32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869537.196296:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2b2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2b32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869537.196342:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83087b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554621056:0@lo:501: 00000100:00100000:1.0:1788869537.196368:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869537.196396:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84fad0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869537.196464:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554621056 00000100:00100000:3.0:1788869537.196468:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554621056 00000100:00100000:3.0:1788869537.196503:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788869537.196510:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554621056:12345-0@lo:501: 00000100:00100000:3.0:1788869537.196664:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554621056:12345-0@lo:501: Request processed in 153us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869537.196671:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788869537.196737:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83087b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554621056:0@lo:501: 00000100:00100000:1.0:1788869537.196762:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83087b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554621184:0@lo:503: 00000100:00100000:1.0:1788869537.196819:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869537.196970:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84fad0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869537.200270:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554621184 00000100:00100000:2.0:1788869537.200286:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554621184 00000100:00100000:2.0:1788869537.200393:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788869537.200402:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554621184:12345-0@lo:503: 00000100:00100000:2.0:1788869537.200562:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554621184:12345-0@lo:503: Request processed in 160us (3742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869537.200571:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788869537.200604:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83087b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554621184:0@lo:503: 00000100:00100000:3.0:1788869537.202672:0:9947:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9947:1875765554621312:0@lo:502: 00000100:00100000:3.0:1788869537.202754:0:9947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869537.202808:0:9947:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcde40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869537.203247:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554621312 00000100:00100000:2.0:1788869537.203288:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554621312 00000100:00100000:2.0:1788869537.203338:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788869537.203347:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:9947:x1875765554621312:12345-0@lo:502: 00000100:00100000:2.0:1788869537.203460:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:9947:x1875765554621312:12345-0@lo:502: Request processed in 114us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869537.203468:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788869537.203505:0:9947:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9947:1875765554621312:0@lo:502: 00000020:01000000:3.0:1788869537.203533:0:9947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869537.203544:0:9947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869537.203547:0:9947:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788869537.203552:0:9947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788869537.203554:0:9947:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788869537.203702:0:9947:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9947:1875765554621440:0@lo:502: 00000100:00100000:2.0:1788869537.203858:0:9947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869537.203885:0:9947:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcde40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869537.203919:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554621440 00000100:00100000:0.0:1788869537.203922:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554621440 00000100:00100000:0.0:1788869537.203947:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788869537.203952:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:9947:x1875765554621440:12345-0@lo:502: 00000100:00100000:0.0:1788869537.204214:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:9947:x1875765554621440:12345-0@lo:502: Request processed in 261us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.204219:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788869537.206873:0:9947:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9947:1875765554621440:0@lo:502: 00000020:01000000:2.0:1788869537.206912:0:9947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869537.206921:0:9947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869537.206923:0:9947:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788869537.206926:0:9947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788869537.207046:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788869537.207069:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788869537.207079:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2b2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2b32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.207090:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2b32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869537.207114:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788869537.207117:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ff89980800 from 39 10000000:01000000:3.0:1788869537.207120:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788869537.207154:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2b39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.207162:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2b39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.207171:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2b39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869537.207189:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554621568:0@lo:101: 00000100:00100000:3.0:1788869537.207247:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869537.207297:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554621568 00000100:00100000:3.0:1788869537.207303:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd540 going to sleep for 11 seconds 00000100:00100000:1.0:1788869537.207304:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554621568 00000100:00100000:1.0:1788869537.207345:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788869537.207352:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554621568:12345-0@lo:101: 00010000:00010000:1.0:1788869537.207362:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869537.207373:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb95a9800/0xbead52e175fc2b40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2b39 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869537.207392:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb95a9800/0xbead52e175fc2b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2b39 expref: 18 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869537.207399:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb95a9800/0xbead52e175fc2b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2b39 expref: 18 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869537.207405:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a9800, rc 0) 00000100:00100000:1.0:1788869537.207438:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554621568:12345-0@lo:101: Request processed in 86us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869537.207444:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788869537.207460:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554621568:0@lo:101: 00010000:00010000:3.0:1788869537.207473:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2b39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2b40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.207494:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2b39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2b40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869537.207541:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554621696:0@lo:501: 00000100:00100000:3.0:1788869537.207567:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869537.207595:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd540 going to sleep for 11 seconds 00000100:00100000:1.0:1788869537.207665:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554621696 00000100:00100000:1.0:1788869537.207669:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554621696 00000100:00100000:1.0:1788869537.207699:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788869537.207706:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554621696:12345-0@lo:501: 00000100:00100000:1.0:1788869537.207827:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554621696:12345-0@lo:501: Request processed in 120us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869537.207841:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788869537.207847:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554621696:0@lo:501: 00000100:00100000:3.0:1788869537.207872:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554621824:0@lo:503: 00000100:00100000:3.0:1788869537.207914:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869537.207937:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd540 going to sleep for 11 seconds 00000100:00100000:0.0:1788869537.208156:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554621824 00000100:00100000:0.0:1788869537.208159:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554621824 00000100:00100000:0.0:1788869537.208185:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788869537.208191:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554621824:12345-0@lo:503: 00000100:00100000:0.0:1788869537.208294:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554621824:12345-0@lo:503: Request processed in 102us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869537.208297:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554621824:0@lo:503: 00000100:00100000:0.0:1788869537.208300:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788869537.209888:0:9948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83087800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9948:1875765554621952:0@lo:502: 00000100:00100000:1.0:1788869537.209959:0:9948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869537.210018:0:9948:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe832af180 going to sleep for 11 seconds 00000100:00100000:0.0:1788869537.210170:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554621952 00000100:00100000:0.0:1788869537.210175:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554621952 00000100:00100000:0.0:1788869537.210207:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788869537.210216:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+18:9948:x1875765554621952:12345-0@lo:502: 00000100:00100000:0.0:1788869537.210335:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+18:9948:x1875765554621952:12345-0@lo:502: Request processed in 120us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.210340:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788869537.210488:0:9948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83087800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9948:1875765554621952:0@lo:502: 00000100:00100000:1.0:1788869537.210534:0:9948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83087800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9948:1875765554622080:0@lo:502: 00000100:00100000:1.0:1788869537.210563:0:9948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869537.210589:0:9948:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe832af180 going to sleep for 11 seconds 00000100:00100000:0.0:1788869537.210938:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554622080 00000100:00100000:0.0:1788869537.210942:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554622080 00000100:00100000:0.0:1788869537.210966:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788869537.210972:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:9948:x1875765554622080:12345-0@lo:502: 00000100:00100000:0.0:1788869537.211202:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:9948:x1875765554622080:12345-0@lo:502: Request processed in 230us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.211207:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788869537.211286:0:9948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83087800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9948:1875765554622080:0@lo:502: 00000040:00080000:1.0:1788869537.211301:0:9948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788869537.211377:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788869537.211397:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788869537.211407:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2b39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2b40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.211418:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2b40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869537.211427:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788869537.211429:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ff89980800 from 6 10000000:01000000:3.0:1788869537.211432:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788869537.211456:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc2b47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.211464:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc2b47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.211473:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc2b47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869537.211501:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554622208:0@lo:101: 00000100:00100000:3.0:1788869537.211532:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869537.211557:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd540 going to sleep for 11 seconds 00000100:00100000:0.0:1788869537.211953:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554622208 00000100:00100000:0.0:1788869537.211958:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554622208 00000100:00100000:0.0:1788869537.211995:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788869537.212027:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554622208:12345-0@lo:101: 00010000:00010000:0.0:1788869537.212036:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869537.212050:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb98e2e00/0xbead52e175fc2b4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2b47 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.212070:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb98e2e00/0xbead52e175fc2b4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2b47 expref: 19 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.212077:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb98e2e00/0xbead52e175fc2b4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2b47 expref: 19 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.212083:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb98e2e00, rc 0) 00000100:00100000:0.0:1788869537.212114:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+19:6481:x1875765554622208:12345-0@lo:101: Request processed in 90us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.212120:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788869537.212142:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554622208:0@lo:101: 00010000:00010000:3.0:1788869537.212156:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc2b47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2b4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.212178:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc2b47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2b4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869537.212223:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554622336:0@lo:256: 00000100:00100000:3.0:1788869537.212271:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869537.212286:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd540 going to sleep for 11 seconds 00000100:00100000:0.0:1788869537.212371:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554622336 00000100:00100000:0.0:1788869537.212375:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554622336 00000100:00100000:0.0:1788869537.212398:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788869537.212404:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+19:6481:x1875765554622336:12345-0@lo:256: 20000000:01000000:0.0:1788869537.212417:0:6478:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788869537.212434:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788869537.212437:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788869537.212517:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+19:6481:x1875765554622336:12345-0@lo:256: Request processed in 113us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.212524:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788869537.212559:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554622336:0@lo:256: 10000000:01000000:3.0:1788869537.212613:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788869537.212620:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc2b47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2b4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.212627:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc2b47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2b4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869537.212634:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788869537.212636:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1788869537.212638:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788869537.212654:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2b55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.212661:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2b55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.212669:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2b55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869537.212680:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554622464:0@lo:101: 00000100:00100000:3.0:1788869537.212714:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869537.212752:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd540 going to sleep for 11 seconds 00000100:00100000:0.0:1788869537.213353:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554622464 00000100:00100000:0.0:1788869537.213359:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554622464 00000100:00100000:0.0:1788869537.213387:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788869537.213394:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+19:6481:x1875765554622464:12345-0@lo:101: 00010000:00010000:0.0:1788869537.213409:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869537.213421:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb98e2800/0xbead52e175fc2b5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2b55 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.213438:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb98e2800/0xbead52e175fc2b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2b55 expref: 20 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.213447:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb98e2800/0xbead52e175fc2b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2b55 expref: 20 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.213454:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb98e2800, rc 0) 00000100:00100000:0.0:1788869537.213489:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+20:6481:x1875765554622464:12345-0@lo:101: Request processed in 95us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.213495:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788869537.213565:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554622464:0@lo:101: 00010000:00010000:3.0:1788869537.213649:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2b55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2b5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.213657:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2b55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2b5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869537.213709:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554622592:0@lo:501: 00000100:00100000:3.0:1788869537.213747:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869537.213788:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd540 going to sleep for 11 seconds 00000100:00100000:0.0:1788869537.213804:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554622592 00000100:00100000:0.0:1788869537.213808:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554622592 00000100:00100000:0.0:1788869537.213836:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788869537.213842:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+20:6481:x1875765554622592:12345-0@lo:501: 00000100:00100000:0.0:1788869537.213946:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+20:6481:x1875765554622592:12345-0@lo:501: Request processed in 104us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.213953:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788869537.213961:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554622592:0@lo:501: 00000100:00100000:3.0:1788869537.213987:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554622720:0@lo:503: 00000100:00100000:3.0:1788869537.214025:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869537.214050:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd540 going to sleep for 11 seconds 00000100:00100000:1.0:1788869537.214082:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554622720 00000100:00100000:1.0:1788869537.214086:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554622720 00000100:00100000:1.0:1788869537.214111:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788869537.214117:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+20:6481:x1875765554622720:12345-0@lo:503: 00000100:00100000:1.0:1788869537.214188:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+20:6481:x1875765554622720:12345-0@lo:503: Request processed in 71us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869537.214195:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788869537.214201:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554622720:0@lo:503: 00000100:00100000:1.0:1788869537.214579:0:9949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83087800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9949:1875765554622848:0@lo:502: 00000100:00100000:1.0:1788869537.214615:0:9949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869537.214645:0:9949:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe832af480 going to sleep for 11 seconds 00000100:00100000:2.0:1788869537.214676:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554622848 00000100:00100000:2.0:1788869537.214679:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554622848 00000100:00100000:2.0:1788869537.214702:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788869537.214709:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+20:9949:x1875765554622848:12345-0@lo:502: 00000100:00100000:2.0:1788869537.214803:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+20:9949:x1875765554622848:12345-0@lo:502: Request processed in 94us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869537.214815:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788869537.214867:0:9949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83087800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9949:1875765554622848:0@lo:502: 00000020:01000000:1.0:1788869537.214883:0:9949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788869537.214889:0:9949:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788869537.214894:0:9949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869537.214899:0:9949:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788869537.214902:0:9949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788869537.214905:0:9949:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:1.0:1788869537.214921:0:9949:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788869537.214922:0:9949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788869537.214934:0:9949:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff99fe82cd8000) 00000020:00000080:1.0:1788869537.214952:0:9949:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1788869537.214955:0:9949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788869537.215159:0:9949:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788869537.215164:0:9949:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788869537.215171:0:9949:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbead52e175fc2b6a 00010000:00080000:1.0:1788869537.215192:0:9949:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fe82ef1800@lustre-OST0001-osc-MDT0001: add connection 192.168.201.130@tcp at head 00010000:00010000:1.0:1788869537.215386:0:9949:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1788869537.215494:0:9949:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788869537.215506:0:9949:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788869537.215681:0:9949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788869537.219079:0:9949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788869537.220123:0:9949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788869537.220210:0:9949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788869537.220917:0:9950:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788869537.220923:0:9950:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788869537.225330:0:9949:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788869537.225343:0:9949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788869537.225379:0:9949:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788869537.225411:0:9949:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbead52e175fc2b71 00000100:00080000:2.0:1788869537.225424:0:9949:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869537.225431:0:9949:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99fe82ef1800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788869537.225472:0:9949:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe82325500 x1875765554622976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869537.225510:0:9949:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788869537.225566:0:9949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869537.225570:0:9949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869537.225572:0:9949:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788869537.225575:0:9949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869537.225579:0:9949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869537.225580:0:9949:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788869537.225584:0:9949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788869537.225585:0:9949:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788869537.225611:0:9949:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82324380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9949:1875765554623104:0@lo:502: 00000100:00100000:2.0:1788869537.225694:0:9949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869537.225730:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554623104 00000100:00100000:2.0:1788869537.225735:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554623104 00000100:00100000:0.0:1788869537.225887:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554623232:0@lo:400: 00000100:00100000:0.0:1788869537.225912:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869537.225927:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554623744:0@lo:400: 00000100:00100000:0.0:1788869537.225939:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869537.225948:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875765554624256:0@lo:400: 00000100:00100000:0.0:1788869537.225959:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869537.225991:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788869537.225995:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554623616:0@lo:400: 00000100:00100000:0.0:1788869537.226019:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869537.226030:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8335c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554624128:0@lo:400: 00000100:00100000:0.0:1788869537.226044:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869537.226060:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554623360:0@lo:400: 00000100:00100000:0.0:1788869537.226073:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869537.226083:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554623872:0@lo:400: 00000100:00100000:0.0:1788869537.226097:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869537.226105:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8335f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554624384:0@lo:400: 00000100:00100000:0.0:1788869537.226116:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869537.226123:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788869537.226125:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554623488:0@lo:400: 00000100:00100000:0.0:1788869537.226135:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869537.226140:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554624000:0@lo:400: 00000100:00100000:0.0:1788869537.226149:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869537.226166:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554623232 00000100:00100000:0.0:1788869537.226169:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554623232 00000100:00100000:0.0:1788869537.226185:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554623744 00000100:00100000:0.0:1788869537.226186:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554623744 00000100:00100000:0.0:1788869537.226200:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554624256 00000100:00100000:0.0:1788869537.226201:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554624256 00000100:00100000:0.0:1788869537.226207:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554623872 00000100:00100000:0.0:1788869537.226209:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554623872 00000100:00100000:0.0:1788869537.226215:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554624384 00000100:00100000:0.0:1788869537.226216:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554624384 00000100:00100000:0.0:1788869537.226222:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554623488 00000100:00100000:0.0:1788869537.226223:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554623488 00000100:00100000:0.0:1788869537.226232:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788869537.226242:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554623232:12345-0@lo:400: 00000100:00100000:0.0:1788869537.226297:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554623232:12345-0@lo:400: Request processed in 55us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.226302:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788869537.226314:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788869537.226318:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554623744:12345-0@lo:400: 00000100:00100000:0.0:1788869537.226332:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554623744:12345-0@lo:400: Request processed in 15us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.226336:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788869537.226342:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788869537.226345:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875765554624256:12345-0@lo:400: 00000100:00100000:0.0:1788869537.226357:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875765554624256:12345-0@lo:400: Request processed in 12us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.226361:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788869537.226366:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788869537.226369:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554623872:12345-0@lo:400: 00000100:00100000:0.0:1788869537.226384:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554623872:12345-0@lo:400: Request processed in 15us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.226387:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788869537.226392:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788869537.226396:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554624384:12345-0@lo:400: 00000100:00100000:0.0:1788869537.226408:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554624384:12345-0@lo:400: Request processed in 13us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.226412:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788869537.226417:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788869537.226420:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554623488:12345-0@lo:400: 00000100:00100000:0.0:1788869537.226442:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554623488:12345-0@lo:400: Request processed in 21us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.226446:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788869537.226463:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554623616 00000100:00100000:0.0:1788869537.226465:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554623616 00000100:00100000:3.0:1788869537.228073:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554622976:0@lo:8: 00000100:00100000:3.0:1788869537.228131:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869537.233680:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554624128 00000100:00100000:1.0:1788869537.233697:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554624128 00000100:00100000:1.0:1788869537.233762:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554624000 00000100:00100000:1.0:1788869537.233765:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554624000 00000100:00100000:1.0:1788869537.233798:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554622976 00000100:00100000:1.0:1788869537.233801:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554622976 00000100:00100000:1.0:1788869537.233816:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788869537.233824:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554624128:12345-0@lo:400: 00000100:00100000:1.0:1788869537.233911:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554624128:12345-0@lo:400: Request processed in 87us (7864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869537.233917:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788869537.233932:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788869537.233954:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554624000:12345-0@lo:400: 00000100:00100000:1.0:1788869537.234030:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554624000:12345-0@lo:400: Request processed in 77us (7878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869537.234035:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788869537.234044:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788869537.234047:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1875765554622976:12345-0@lo:8: 00010000:00080000:1.0:1788869537.234068:0:8399:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:1.0:1788869537.234091:0:8399:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbead52e175fc2b78 00002000:00100000:1.0:1788869537.234102:0:8399:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff99fe82ef0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788869537.234105:0:8399:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1788869537.234107:0:8399:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788869537.234156:0:8399:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:0.0:1788869537.234372:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788869537.234376:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869537.234378:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869537.234385:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554623360 00000100:00100000:0.0:1788869537.234388:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554623360 00000100:00100000:0.0:1788869537.234402:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788869537.234406:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554623616:12345-0@lo:400: 00000100:00100000:0.0:1788869537.234435:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554623616:12345-0@lo:400: Request processed in 29us (8416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.234439:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788869537.234448:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788869537.234451:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554623360:12345-0@lo:400: 00000100:00100000:0.0:1788869537.234465:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554623360:12345-0@lo:400: Request processed in 14us (8392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.234469:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1788869537.234503:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe81c8dc00 x1875765554623488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869537.234518:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554623488:0@lo:400: 00010000:00080000:0.0:1788869537.234531:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffac4ec700 x1875765554624000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869537.234538:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554624000:0@lo:400: 00000100:00100000:0.0:1788869537.234561:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554623360:0@lo:400: 00010000:00080000:0.0:1788869537.234571:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe81c8ed80 x1875765554623872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869537.234579:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554623872:0@lo:400: 00010000:00080000:0.0:1788869537.234589:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8335f800 x1875765554624384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869537.234596:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8335f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554624384:0@lo:400: 00000100:00100000:0.0:1788869537.234633:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554623616:0@lo:400: 00010000:00080000:0.0:1788869537.234642:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8335c380 x1875765554624128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869537.234650:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8335c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554624128:0@lo:400: 00010000:00080000:0.0:1788869537.234661:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe81c8f800 x1875765554623232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869537.234668:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554623232:0@lo:400: 00010000:00080000:0.0:1788869537.234677:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe81c8f480 x1875765554623744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869537.234684:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554623744:0@lo:400: 00010000:00080000:0.0:1788869537.234693:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8335fb80 x1875765554624256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869537.234699:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875765554624256:0@lo:400: 00000100:00100000:2.0:1788869537.235661:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788869537.235674:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88938450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+20:9949:x1875765554623104:12345-0@lo:502: 00000100:00100000:2.0:1788869537.235806:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88938450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+20:9949:x1875765554623104:12345-0@lo:502: Request processed in 137us (10112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869537.235812:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00002000:00080000:1.0:1788869537.236650:0:8399:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788869537.236676:0:8399:0:(import.c:65:import_set_state_nolock()) ffff99fe82ef5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869537.236729:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3615:x1875765554622976:12345-0@lo:8: Request processed in 2679us (8595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869537.236735:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788869537.236796:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82325500 x1875765554622976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869537.236808:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788869537.236817:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788869537.236827:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788869537.236841:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788869537.236844:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99fe82ef1800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788869537.236867:0:3615:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:3.0:1788869537.236872:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554622976:0@lo:8: 00000004:00080000:3.0:1788869537.236897:0:9950:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788869537.236956:0:9950:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 155163702577ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788869537.236962:0:9950:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788869537.237183:0:9951:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8335fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9951:1875765554624512:0@lo:700: 00000100:00100000:0.0:1788869537.237220:0:9951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869537.237241:0:9951:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89afbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869537.237274:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554624512 00000100:00100000:3.0:1788869537.237280:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554624512 00000100:00100000:3.0:1788869537.237331:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869537.237339:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9951:x1875765554624512:12345-0@lo:700: 00000100:00080000:0.0:1788869537.237348:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869537.237368:0:8408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228d500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8408:1875765554624640:0@lo:700: 00000100:00100000:3.0:1788869537.237395:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869537.237420:0:8408:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869537.237562:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554624640 00000100:00100000:0.0:1788869537.237565:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554624640 00000100:00100000:0.0:1788869537.237605:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869537.237611:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8408:x1875765554624640:12345-0@lo:700: 00000100:00100000:2.0:1788869537.239939:0:9949:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b88600 going to sleep for 11 seconds 00000100:00100000:2.0:1788869537.240129:0:9949:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82324380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9949:1875765554623104:0@lo:502: 00000020:01000000:2.0:1788869537.240163:0:9949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869537.240169:0:9949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869537.240171:0:9949:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788869537.240174:0:9949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000004:00080000:2.0:1788869537.242577:0:7415:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000020:01000000:3.0:1788869537.242786:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1788869537.242819:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788869537.242829:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2b55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2b5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.242838:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2b55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2b5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869537.242847:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788869537.242849:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ff8b15e800 from 39 10000000:01000000:3.0:1788869537.242850:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788869537.242879:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc2b7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.242885:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc2b7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.242899:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc2b7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869537.242917:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554624768:0@lo:101: 00000100:00100000:3.0:1788869537.242968:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869537.243208:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd900 going to sleep for 11 seconds 40000000:02000000:0.0:1788869537.245936:0:6491:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1788869537.249505:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8408:x1875765554624640:12345-0@lo:700: Request processed in 11887us (12102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.249518:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869537.252354:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554624768 00000100:00100000:2.0:1788869537.252366:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554624768 00000100:00100000:2.0:1788869537.252420:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788869537.252427:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88938c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+20:6481:x1875765554624768:12345-0@lo:101: 00010000:00010000:2.0:1788869537.252442:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869537.252456:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff81534e00/0xbead52e175fc2b86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2b7f expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.252479:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff81534e00/0xbead52e175fc2b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2b7f expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.252486:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff81534e00/0xbead52e175fc2b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2b7f expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.252493:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534e00, rc 0) 00000100:00100000:2.0:1788869537.252554:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88938c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554624768:12345-0@lo:101: Request processed in 128us (9585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869537.252559:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788869537.252684:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554624768:0@lo:101: 00010000:00010000:0.0:1788869537.252700:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc2b7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2b86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.252707:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc2b7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2b86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869537.252785:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8335f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554624896:0@lo:501: 00000100:00100000:0.0:1788869537.252819:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869537.252849:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89afbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869537.253406:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554624896 00000100:00100000:2.0:1788869537.253411:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554624896 00000100:00100000:2.0:1788869537.253431:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788869537.253436:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554624896:12345-0@lo:501: 00000100:00100000:2.0:1788869537.253544:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554624896:12345-0@lo:501: Request processed in 108us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869537.253560:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788869537.253636:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8335f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554624896:0@lo:501: 00000100:00100000:1.0:1788869537.253663:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83087800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554625024:0@lo:503: 00000100:00100000:1.0:1788869537.253695:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869537.253719:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe832afa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869537.253765:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554625024 00000100:00100000:0.0:1788869537.253780:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554625024 00000100:00100000:0.0:1788869537.253814:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788869537.253819:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554625024:12345-0@lo:503: 00000100:00100000:0.0:1788869537.253884:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554625024:12345-0@lo:503: Request processed in 65us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.253895:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788869537.253955:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83087800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554625024:0@lo:503: 00010000:00080000:3.0:1788869537.255458:0:8408:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8228d500 x1875765554624640/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788869553 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869537.255471:0:8408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228d500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8408:1875765554624640:0@lo:700: 40000000:02000000:3.0:1788869537.255481:0:8408:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:1.0:1788869537.256849:0:9952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83087800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9952:1875765554625152:0@lo:502: 00000100:00100000:1.0:1788869537.256906:0:9952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869537.256949:0:9952:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe832af300 going to sleep for 11 seconds 00000100:00100000:0.0:1788869537.257000:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554625152 00000100:00100000:0.0:1788869537.257013:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554625152 00000100:00100000:0.0:1788869537.257049:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788869537.257055:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+21:9952:x1875765554625152:12345-0@lo:502: 00000100:00100000:0.0:1788869537.257227:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+21:9952:x1875765554625152:12345-0@lo:502: Request processed in 172us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.257232:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788869537.263318:0:9952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83087800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9952:1875765554625152:0@lo:502: 00000100:00100000:2.0:1788869537.265000:0:9952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82324380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9952:1875765554625280:0@lo:502: 00000100:00100000:2.0:1788869537.265081:0:9952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869537.265113:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554625280 00000100:00100000:2.0:1788869537.265118:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554625280 00000100:00100000:2.0:1788869537.265155:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788869537.265160:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88938850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:9952:x1875765554625280:12345-0@lo:502: 00000100:00100000:2.0:1788869537.265247:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88938850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:9952:x1875765554625280:12345-0@lo:502: Request processed in 86us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869537.265267:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788869537.265306:0:9952:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b88a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788869537.265320:0:9952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82324380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9952:1875765554625280:0@lo:502: 00000040:00080000:2.0:1788869537.265337:0:9952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1788869537.266340:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788869537.266365:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788869537.266373:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc2b7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2b86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869537.266382:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc2b7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2b86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869537.266389:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788869537.266390:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ff8b15e800 from 6 10000000:01000000:1.0:1788869537.266392:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788869537.266420:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8600/0xbead52e175fc2b8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869537.266426:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8600/0xbead52e175fc2b8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869537.266433:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8600/0xbead52e175fc2b8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869537.266445:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83085180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554625408:0@lo:101: 00000100:00100000:1.0:1788869537.266480:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869537.266516:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe832afd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788869537.266565:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554625408 00000100:00100000:2.0:1788869537.266569:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554625408 00000100:00100000:2.0:1788869537.266651:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788869537.266657:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88939050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554625408:12345-0@lo:101: 00010000:00010000:2.0:1788869537.266666:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869537.266677:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff81534000/0xbead52e175fc2b94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2b8d expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.266696:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff81534000/0xbead52e175fc2b94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2b8d expref: 22 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.266705:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff81534000/0xbead52e175fc2b94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2b8d expref: 22 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.266722:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534000, rc 0) 00000100:00100000:2.0:1788869537.266764:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88939050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554625408:12345-0@lo:101: Request processed in 107us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869537.266780:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788869537.266844:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83085180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554625408:0@lo:101: 00010000:00010000:1.0:1788869537.266858:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8600/0xbead52e175fc2b8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2b94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869537.266867:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8600/0xbead52e175fc2b8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2b94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869537.266915:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83085180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554625536:0@lo:256: 00000100:00100000:1.0:1788869537.266943:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869537.274341:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe832afd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869537.275272:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554625536 00000100:00100000:3.0:1788869537.275282:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554625536 00000100:00100000:3.0:1788869537.275335:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788869537.275345:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554625536:12345-0@lo:256: 20000000:01000000:3.0:1788869537.275371:0:6479:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788869537.275391:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788869537.275394:0:6479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788869537.275575:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83085180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554625536:0@lo:256: 10000000:01000000:1.0:1788869537.278004:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788869537.278018:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8600/0xbead52e175fc2b8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2b94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869537.278030:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8600/0xbead52e175fc2b8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2b94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869537.278039:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788869537.278042:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788869537.278046:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788869537.278084:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2b9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869537.278093:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2b9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869537.278103:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2b9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869537.278124:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83085180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554625664:0@lo:101: 00000100:00100000:1.0:1788869537.278184:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869537.278225:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe832afd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788869537.278289:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554625664 00000100:00100000:2.0:1788869537.278296:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554625664 00000100:00100000:2.0:1788869537.278335:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788869537.278344:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88939c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554625664:12345-0@lo:101: 00010000:00010000:2.0:1788869537.278356:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869537.278368:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2ba2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2b9b expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.278392:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2ba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2b9b expref: 24 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.278401:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2ba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2b9b expref: 24 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.278409:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534a00, rc 0) 00000100:00100000:2.0:1788869537.278449:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88939c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554625664:12345-0@lo:101: Request processed in 107us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869537.278455:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788869537.278498:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83085180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554625664:0@lo:101: 00010000:00010000:2.0:1788869537.278511:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2b9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2ba2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.278520:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2b9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2ba2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869537.278586:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82324380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554625792:0@lo:501: 00000100:00100000:2.0:1788869537.278611:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869537.278629:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8b72240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869537.278640:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554625792 00000100:00100000:2.0:1788869537.278644:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554625792 00000100:00100000:2.0:1788869537.278660:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788869537.278665:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88939850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554625792:12345-0@lo:501: 00000100:00100000:2.0:1788869537.278783:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88939850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554625792:12345-0@lo:501: Request processed in 117us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869537.278790:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788869537.278819:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82324380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554625792:0@lo:501: 00000100:00100000:2.0:1788869537.278842:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82324380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554625920:0@lo:503: 00000100:00100000:2.0:1788869537.278883:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869537.278896:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8b72240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869537.278908:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554625920 00000100:00100000:2.0:1788869537.278912:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554625920 00000100:00100000:2.0:1788869537.278928:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788869537.278934:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88939450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554625920:12345-0@lo:503: 00000100:00100000:2.0:1788869537.279048:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88939450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554625920:12345-0@lo:503: Request processed in 113us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869537.279054:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788869537.279089:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82324380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554625920:0@lo:503: 00000100:00100000:2.0:1788869537.279282:0:9953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82324380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9953:1875765554626048:0@lo:502: 00000100:00100000:2.0:1788869537.279317:0:9953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869537.279343:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554626048 00000100:00100000:2.0:1788869537.279347:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554626048 00000100:00100000:2.0:1788869537.279365:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788869537.279371:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88938050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:9953:x1875765554626048:12345-0@lo:502: 00000100:00100000:2.0:1788869537.279442:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88938050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:9953:x1875765554626048:12345-0@lo:502: Request processed in 71us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869537.279448:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788869537.279480:0:9953:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8b72840 going to sleep for 11 seconds 00000100:00100000:2.0:1788869537.279492:0:9953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82324380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9953:1875765554626048:0@lo:502: 00000020:01000000:2.0:1788869537.279513:0:9953:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788869537.279520:0:9953:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788869537.279526:0:9953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869537.279529:0:9953:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788869537.279533:0:9953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788869537.279536:0:9953:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:2.0:1788869537.279557:0:9953:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788869537.279560:0:9953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788869537.279576:0:9953:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99ffb981b380) 00000020:00000080:2.0:1788869537.279597:0:9953:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1788869537.279602:0:9953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788869537.279666:0:9953:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788869537.279672:0:9953:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788869537.279679:0:9953:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbead52e175fc2bb0 00010000:00080000:2.0:1788869537.279705:0:9953:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffb9b2c000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.130@tcp at head 00000001:00100000:0.0:1788869537.280423:0:9476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:2.0:1788869537.280616:0:9953:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1788869537.280733:0:9953:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1788869537.280733:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9951:x1875765554624512:12345-0@lo:700: Request processed in 43394us (43510us total) trans 0 rc 0/0 00000040:01000000:2.0:1788869537.280744:0:9953:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788869537.280748:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788869537.280845:0:9951:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8335fb80 x1875765554624512/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788869553 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869537.280858:0:9951:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8335fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9951:1875765554624512:0@lo:700: 00000040:00080000:2.0:1788869537.280950:0:9953:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869537.281517:0:9953:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869537.281658:0:9953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788869537.281728:0:9953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000100:00100000:3.0:1788869537.281823:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554625536:12345-0@lo:256: Request processed in 6477us (14877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869537.281833:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000040:00080000:3.0:1788869537.282034:0:9954:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788869537.282038:0:9954:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788869537.282816:0:9953:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788869537.282827:0:9953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788869537.282861:0:9953:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788869537.282883:0:9953:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbead52e175fc2bb7 00000100:00080000:2.0:1788869537.282891:0:9953:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869537.282896:0:9953:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ffb9b2c000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788869537.282924:0:9953:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe82324380 x1875765554626176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869537.282949:0:9953:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1788869537.283086:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554626176:0@lo:8: 00000100:00100000:3.0:1788869537.283148:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788869537.283174:0:9953:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869537.283178:0:9953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869537.283179:0:9953:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788869537.283182:0:9953:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869537.283185:0:9953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869537.283187:0:9953:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788869537.283189:0:9953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788869537.283191:0:9953:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788869537.283213:0:9953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82327b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9953:1875765554626304:0@lo:502: 00000100:00100000:2.0:1788869537.283307:0:9953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869537.283336:0:9953:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8b72000 going to sleep for 11 seconds 00000100:00100000:0.0:1788869537.283380:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554626176 00000100:00100000:0.0:1788869537.283387:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554626176 00000100:00100000:0.0:1788869537.283420:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788869537.283427:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1875765554626176:12345-0@lo:8: 00010000:00080000:0.0:1788869537.283449:0:8527:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:0.0:1788869537.283469:0:8527:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbead52e175fc2bbe 00002000:00100000:0.0:1788869537.283486:0:8527:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99fe81f37000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788869537.283490:0:8527:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788869537.283492:0:8527:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788869537.283554:0:8527:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788869537.283573:0:8527:0:(import.c:65:import_set_state_nolock()) ffff99fe81f33800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869537.283616:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3615:x1875765554626176:12345-0@lo:8: Request processed in 188us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.283630:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788869537.283662:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82324380 x1875765554626176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869537.283671:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788869537.283677:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788869537.283683:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788869537.283687:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788869537.283689:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffb9b2c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788869537.283847:0:3615:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:0.0:1788869537.283853:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554626176:0@lo:8: 00000004:00080000:2.0:1788869537.283896:0:9954:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788869537.283937:0:9954:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 155210684016ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788869537.283944:0:9954:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788869537.284629:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554626304 00000100:00100000:3.0:1788869537.284642:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554626304 00000100:00100000:3.0:1788869537.284676:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788869537.284682:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+23:9953:x1875765554626304:12345-0@lo:502: 00000100:00100000:3.0:1788869537.284956:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+23:9953:x1875765554626304:12345-0@lo:502: Request processed in 273us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869537.284964:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788869537.285142:0:9953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82327b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:9953:1875765554626304:0@lo:502: 00000020:01000000:2.0:1788869537.285169:0:9953:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869537.285175:0:9953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869537.285177:0:9953:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788869537.285181:0:9953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:0.0:1788869537.293246:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1788869537.293296:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788869537.293307:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2b9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2ba2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.293320:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2b9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2ba2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869537.293331:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788869537.293334:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99ff8b770000 from 1 10000000:01000000:0.0:1788869537.293337:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788869537.293370:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2600/0xbead52e175fc2bc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.293378:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2600/0xbead52e175fc2bc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.293388:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2600/0xbead52e175fc2bc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869537.293421:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8335fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554626432:0@lo:101: 00000100:00100000:0.0:1788869537.293482:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788869537.294033:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788869537.294108:0:9955:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788869537.294124:0:9955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83086d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9955:1875765554626688:0@lo:7: 00000100:00100000:1.0:1788869537.294177:0:9955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869537.294212:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554626688 00000100:00100000:1.0:1788869537.294218:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554626688 00000100:00100000:1.0:1788869537.294290:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869537.294300:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9955:x1875765554626688:12345-0@lo:7: 00000100:00100000:0.0:1788869537.295602:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89afbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869537.295626:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554626560:0@lo:13: 00000100:00100000:0.0:1788869537.295675:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788869537.295712:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869537.295728:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554626560 00000100:00100000:0.0:1788869537.295734:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554626560 00000100:00100000:0.0:1788869537.295787:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788869537.295795:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1875765554626560:12345-0@lo:13: 00002000:00000024:0.0:1788869537.295818:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923939328 avail 3692417024 00000100:00100000:0.0:1788869537.295863:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1875765554626560:12345-0@lo:13: Request processed in 68us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.295870:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788869537.295909:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83085880 x1875765554626560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869537.295926:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554626560:0@lo:13: 00000100:00100000:3.0:1788869537.301682:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554626432 00000100:00100000:3.0:1788869537.301696:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554626432 00000100:00100000:3.0:1788869537.301762:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788869537.301782:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554626432:12345-0@lo:101: 00010000:00010000:3.0:1788869537.301798:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869537.301817:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb9a9e400/0xbead52e175fc2bcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2bc5 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.301845:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb9a9e400/0xbead52e175fc2bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2bc5 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.301857:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb9a9e400/0xbead52e175fc2bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2bc5 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869537.301867:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9e400, rc 0) 00000100:00100000:3.0:1788869537.301952:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554626432:12345-0@lo:101: Request processed in 172us (8469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869537.301958:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788869537.302008:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8335fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554626432:0@lo:101: 00010000:00010000:2.0:1788869537.302028:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2600/0xbead52e175fc2bc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2bcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869537.302039:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2600/0xbead52e175fc2bc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2bcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869537.302110:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82327b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554626816:0@lo:501: 00000100:00100000:2.0:1788869537.302155:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869537.302183:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8b72000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869537.302221:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554626816 00000100:00100000:3.0:1788869537.302226:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554626816 00000100:00100000:3.0:1788869537.302366:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788869537.302375:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554626816:12345-0@lo:501: 00000100:00100000:3.0:1788869537.302445:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554626816:12345-0@lo:501: Request processed in 71us (289us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788869537.302458:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788869537.303410:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8335f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554626944:0@lo:13: 00000100:00100000:0.0:1788869537.303456:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869537.303498:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554626944 00000100:00100000:0.0:1788869537.303503:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554626944 00000100:00100000:0.0:1788869537.303534:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788869537.303541:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554626944:12345-0@lo:13: 00002000:00000024:0.0:1788869537.303559:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923939328 avail 3692417024 00000100:00100000:0.0:1788869537.303609:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554626944:12345-0@lo:13: Request processed in 69us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.303625:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788869537.303665:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8335f100 x1875765554626944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869537.303683:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8335f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554626944:0@lo:13: 00000004:00080000:0.0:1788869537.303700:0:9951:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788869537.303717:0:9951:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8335f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9951:1875765554627072:0@lo:7: 00000100:00100000:0.0:1788869537.303741:0:9951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869537.303775:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554627072 00000100:00100000:0.0:1788869537.303787:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554627072 00000100:00100000:0.0:1788869537.303812:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788869537.303819:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9951:x1875765554627072:12345-0@lo:7: 00000100:00100000:0.0:1788869537.303974:0:9951:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89afb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869537.305280:0:9955:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe832af9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869537.306301:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82327b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554626816:0@lo:501: 10000000:01000000:0.0:1788869537.306347:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788869537.306357:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2600/0xbead52e175fc2bc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2bcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869537.306367:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2600/0xbead52e175fc2bc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2bcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788869537.315623:0:8400:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788869537.315632:0:8400:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788869537.315730:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9955:x1875765554626688:12345-0@lo:7: Request processed in 21427us (21547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869537.315740:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788869537.335896:0:9955:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83086d80 x1875765554626688/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788869553 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869537.335914:0:9955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83086d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9955:1875765554626688:0@lo:7: 00000004:00080000:1.0:1788869537.335930:0:9955:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788869537.335976:0:9955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83086d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9955:1875765554627200:0@lo:5: 00000100:00100000:1.0:1788869537.336033:0:9955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869537.337334:0:9955:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe832af9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869537.341115:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554627200 00000100:00100000:2.0:1788869537.341128:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554627200 00000100:00100000:3.0:1788869537.341361:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869537.341374:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9955:x1875765554627200:12345-0@lo:5: 00002000:00080000:3.0:1788869537.341407:0:8401:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788869537.341411:0:8401:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00002000:00080000:0.0:1788869537.346523:0:8527:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788869537.346533:0:8527:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788869537.347189:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9951:x1875765554627072:12345-0@lo:7: Request processed in 43364us (43441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869537.347201:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788869537.347640:0:9951:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8335f100 x1875765554627072/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788869553 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869537.347656:0:9951:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8335f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9951:1875765554627072:0@lo:7: 00000004:00080000:2.0:1788869537.347671:0:9951:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788869537.347710:0:9951:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82327800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9951:1875765554627328:0@lo:5: 00000100:00100000:2.0:1788869537.347748:0:9951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869537.347854:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554627328 00000100:00100000:1.0:1788869537.347861:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554627328 00000100:00100000:1.0:1788869537.347911:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788869537.347921:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9951:x1875765554627328:12345-0@lo:5: 00002000:00080000:1.0:1788869537.347946:0:8400:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1788869537.347986:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9951:x1875765554627328:12345-0@lo:5: Request processed in 67us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869537.347992:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788869537.348031:0:9951:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8b72240 going to sleep for 11 seconds 00010000:00080000:2.0:1788869537.348045:0:9951:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82327800 x1875765554627328/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869553 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869537.348054:0:9951:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82327800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9951:1875765554627328:0@lo:5: 00000004:00080000:2.0:1788869537.348062:0:9951:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788869537.348085:0:9951:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82327800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9951:1875765554627456:0@lo:5: 00000100:00100000:2.0:1788869537.348107:0:9951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869537.348136:0:9951:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8b72240 going to sleep for 11 seconds 00000100:00100000:0.0:1788869537.348295:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554627456 00000100:00100000:0.0:1788869537.348300:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554627456 00000100:00100000:0.0:1788869537.348387:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788869537.348396:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9951:x1875765554627456:12345-0@lo:5: 00002000:00080000:0.0:1788869537.348434:0:8527:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1788869537.353180:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9951:x1875765554627456:12345-0@lo:5: Request processed in 4780us (5065us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788869537.353194:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788869537.353477:0:9951:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82327800 x1875765554627456/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869553 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869537.353496:0:9951:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82327800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9951:1875765554627456:0@lo:5: 00000004:00080000:0.0:1788869537.353511:0:9951:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788869537.353554:0:9951:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8335d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9951:1875765554627584:0@lo:900: 00000100:00100000:0.0:1788869537.353647:0:9951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869537.353719:0:9951:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99a6900 going to sleep for 11 seconds 00000100:00100000:1.0:1788869537.354453:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554627584 00000100:00100000:1.0:1788869537.354462:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554627584 00000100:00100000:1.0:1788869537.354508:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869537.354516:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9951:x1875765554627584:12345-0@lo:900: 00000100:00100000:1.0:1788869537.354653:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9951:x1875765554627584:12345-0@lo:900: Request processed in 138us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869537.354660:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788869537.354740:0:9951:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8335d500 x1875765554627584/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788869553 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869537.354754:0:9951:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8335d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9951:1875765554627584:0@lo:900: 00000001:00080000:2.0:1788869537.367332:0:9476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:2.0:1788869537.367346:0:9476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788869537.367355:0:9476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788869537.367573:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9955:x1875765554627200:12345-0@lo:5: Request processed in 26191us (31528us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788869537.367584:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788869537.368100:0:9955:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83086d80 x1875765554627200/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869553 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869537.368113:0:9955:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788869537.368120:0:9955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83086d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9955:1875765554627200:0@lo:5: 00000004:00080000:1.0:1788869537.368136:0:9955:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788869537.368182:0:9955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83086d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9955:1875765554627712:0@lo:700: 00000100:00100000:1.0:1788869537.368222:0:9955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869537.368291:0:9955:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe832af9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869537.369305:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554627712 00000100:00100000:3.0:1788869537.369315:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554627712 00000100:00100000:3.0:1788869537.369387:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869537.369396:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9955:x1875765554627712:12345-0@lo:700: 00000100:00100000:3.0:1788869537.386697:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9955:x1875765554627712:12345-0@lo:700: Request processed in 17292us (18464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869537.386710:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788869537.386892:0:9955:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83086d80 x1875765554627712/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788869553 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869537.386908:0:9955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83086d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9955:1875765554627712:0@lo:700: 00000004:02000040:1.0:1788869537.391966:0:9955:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1788869537.401955:0:9955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83086d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9955:1875765554627840:0@lo:5: 00000100:00100000:1.0:1788869537.402025:0:9955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869537.402166:0:9955:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe832af9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869537.410554:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554627840 00000100:00100000:2.0:1788869537.410625:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554627840 00000100:00100000:2.0:1788869537.410751:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788869537.410771:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9955:x1875765554627840:12345-0@lo:5: 00002000:00080000:0.0:1788869537.438617:0:8399:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788869537.438640:0:8399:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1788869537.448914:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9955:x1875765554627840:12345-0@lo:5: Request processed in 38148us (46882us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788869537.448927:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788869537.449089:0:9955:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83086d80 x1875765554627840/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869553 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869537.449105:0:9955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83086d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9955:1875765554627840:0@lo:5: 00000004:00080000:1.0:1788869537.449119:0:9955:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:2.0:1788869537.688507:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788869537.743640:0:9476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000020:00000004:3.0:1788869538.591061:0:10005:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788869538.591445:0:10005:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788869538.713846:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869539.736703:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554627968:0@lo:13: 00000100:00100000:1.0:1788869539.736779:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869539.736857:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554627968 00000100:00100000:1.0:1788869539.736864:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554627968 00000100:00100000:1.0:1788869539.736915:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788869539.736922:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554627968:12345-0@lo:13: 00002000:00000024:1.0:1788869539.737121:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869539.737164:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554627968:12345-0@lo:13: Request processed in 242us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869539.737171:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788869539.737191:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869539.737218:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83085880 x1875765554627968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869539.737235:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554627968:0@lo:13: 00000100:00100000:2.0:1788869539.737393:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869539.737402:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554628096:0@lo:13: 00000100:00100000:2.0:1788869539.737429:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869539.738247:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869539.738359:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554628096 00000100:00100000:1.0:1788869539.738366:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554628096 00000100:00100000:1.0:1788869539.738413:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788869539.738420:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554628096:12345-0@lo:13: 00002000:00000024:1.0:1788869539.738436:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869539.738480:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554628096:12345-0@lo:13: Request processed in 61us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869539.738487:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788869539.738539:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82326d80 x1875765554628096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869539.738555:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554628096:0@lo:13: 00000100:00080000:2.0:1788869539.739644:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:3.0:1788869539.783922:0:10053:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788869539.783934:0:10053:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1788869540.249784:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869540.249812:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554628224:0@lo:41: 00000100:00100000:0.0:1788869540.249896:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869540.250312:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554628224 00000100:00100000:2.0:1788869540.250321:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554628224 00000100:00100000:2.0:1788869540.250373:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788869540.250383:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554628224:12345-0@lo:41: 00000004:00000024:2.0:1788869540.250427:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869540.250484:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554628224:12345-0@lo:41: Request processed in 102us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869540.250491:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788869540.250702:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554628224:0@lo:41: 00000100:00100000:3.0:1788869540.484749:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869540.489134:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545140352 00000100:00100000:1.0:1788869540.489151:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545140352 00000100:00100000:1.0:1788869540.489214:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 178 00000100:00100000:1.0:1788869540.489222:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2386:x1875765545140352:12345-192.168.201.30@tcp:250: 00010000:00080000:1.0:1788869540.489311:0:6478:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 3df077ce-aecd-4e92-8493-7099e13a8f7b@192.168.201.30@tcp t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:1.0:1788869540.489346:0:6478:0:(genops.c:1406:class_connect()) connect: client 3df077ce-aecd-4e92-8493-7099e13a8f7b, cookie 0xbead52e175fc2bd3 00000100:00080000:1.0:1788869540.489479:0:6478:0:(import.c:65:import_set_state_nolock()) ffff99fe83378000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869540.489755:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+5:2386:x1875765545140352:12345-192.168.201.30@tcp:250: Request processed in 531us (5014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869540.489764:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 178 00000100:00100000:0.0:1788869540.513850:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869540.513961:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545140480 00000100:00100000:3.0:1788869540.513972:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545140480 00000100:00100000:3.0:1788869540.514086:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 179 00000100:00100000:3.0:1788869540.514097:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff85f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+5:6141:x1875765545140480:12345-192.168.201.30@tcp:101: 00010000:00010000:3.0:1788869540.514114:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869540.514143:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb9a9fc00/0xbead52e175fc2bda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa894 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869540.514172:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb9a9fc00/0xbead52e175fc2bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa894 expref: 6 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869540.514182:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb9a9fc00/0xbead52e175fc2bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa894 expref: 6 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869540.514190:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9fc00, rc 0) 00000100:00100000:3.0:1788869540.514287:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff85f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+6:6141:x1875765545140480:12345-192.168.201.30@tcp:101: Request processed in 156us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869540.514294:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 179 00000100:00100000:2.0:1788869540.521012:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869540.521145:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545140608 00000100:00100000:1.0:1788869540.521155:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545140608 00000100:00100000:1.0:1788869540.521218:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 180 00000100:00100000:1.0:1788869540.521228:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+6:6141:x1875765545140608:12345-192.168.201.30@tcp:501: 00000100:00100000:1.0:1788869540.521368:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+6:6141:x1875765545140608:12345-192.168.201.30@tcp:501: Request processed in 140us (364us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788869540.521377:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 180 00000100:00100000:0.0:1788869540.536607:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869540.540263:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545140736 00000100:00100000:3.0:1788869540.540277:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545140736 00000100:00100000:2.0:1788869540.542740:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 181 00000100:00100000:2.0:1788869540.542755:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+6:6141:x1875765545140736:12345-192.168.201.30@tcp:101: 00010000:00010000:2.0:1788869540.542774:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869540.542793:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff81535200/0xbead52e175fc2be1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa89b expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869540.542846:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff81535200/0xbead52e175fc2be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa89b expref: 7 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869540.542871:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff81535200/0xbead52e175fc2be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa89b expref: 7 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869540.542882:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81535200, rc 0) 00000100:00100000:2.0:1788869540.542970:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+7:6141:x1875765545140736:12345-192.168.201.30@tcp:101: Request processed in 217us (6372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869540.542978:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 181 00000100:00100000:0.0:1788869540.558355:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869540.560076:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545140864 00000100:00100000:2.0:1788869540.560093:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545140864 00000100:00100000:2.0:1788869540.560175:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 182 00000100:00100000:2.0:1788869540.560187:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+7:6141:x1875765545140864:12345-192.168.201.30@tcp:501: 00000100:00100000:2.0:1788869540.560406:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+8:6141:x1875765545140864:12345-192.168.201.30@tcp:501: Request processed in 221us (2059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869540.560414:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 182 00000100:00100000:3.0:1788869540.563097:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869540.564171:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545140992 00000100:00100000:2.0:1788869540.564183:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545140992 00000100:00100000:2.0:1788869540.564289:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 183 00000100:00100000:2.0:1788869540.564302:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+8:6141:x1875765545140992:12345-192.168.201.30@tcp:503: 00000100:00100000:2.0:1788869540.564469:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+8:6141:x1875765545140992:12345-192.168.201.30@tcp:503: Request processed in 169us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869540.564477:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 183 00000100:00100000:0.0:1788869540.575590:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869540.575761:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545141120 00000100:00100000:2.0:1788869540.575786:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545141120 00000100:00100000:2.0:1788869540.576148:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 184 00000100:00100000:2.0:1788869540.576163:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8a775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+8:6160:x1875765545141120:12345-192.168.201.30@tcp:502: 00000100:00100000:2.0:1788869540.577489:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8a775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+8:6160:x1875765545141120:12345-192.168.201.30@tcp:502: Request processed in 1322us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869540.584062:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 184 00000100:00100000:0.0:1788869540.627392:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869540.627511:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545141248 00000100:00100000:1.0:1788869540.627520:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545141248 00000100:00100000:1.0:1788869540.627578:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 185 00000100:00100000:1.0:1788869540.627587:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8a777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+8:6160:x1875765545141248:12345-192.168.201.30@tcp:502: 00000100:00100000:1.0:1788869540.627758:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8a777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+8:6160:x1875765545141248:12345-192.168.201.30@tcp:502: Request processed in 170us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869540.627767:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 185 00000100:00100000:0.0:1788869540.636356:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869540.636462:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545141376 00000100:00100000:2.0:1788869540.636472:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545141376 00000100:00100000:2.0:1788869540.636546:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 186 00000100:00100000:2.0:1788869540.636557:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8a775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+8:6141:x1875765545141376:12345-192.168.201.30@tcp:101: 00010000:00010000:2.0:1788869540.636574:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869540.636593:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff81534200/0xbead52e175fc2be8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa8cc expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869540.636624:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff81534200/0xbead52e175fc2be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa8cc expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869540.636638:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff81534200/0xbead52e175fc2be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa8cc expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869540.636647:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534200, rc 0) 00000100:00100000:2.0:1788869540.636712:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8a775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+9:6141:x1875765545141376:12345-192.168.201.30@tcp:101: Request processed in 156us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869540.636719:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 186 00000100:00100000:0.0:1788869540.642596:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869540.644680:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545141504 00000100:00100000:3.0:1788869540.644705:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545141504 00000100:00100000:3.0:1788869540.644781:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 187 00000100:00100000:3.0:1788869540.644793:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff994d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+9:6141:x1875765545141504:12345-192.168.201.30@tcp:256: 20000000:01000000:0.0:1788869540.654682:0:6476:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788869540.654752:0:6476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788869540.654757:0:6476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788869540.654760:0:6476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788869540.654763:0:6476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788869540.654766:0:6476:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1788869540.657919:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff994d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+9:6141:x1875765545141504:12345-192.168.201.30@tcp:256: Request processed in 13116us (15320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869540.657934:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 187 00000100:00100000:3.0:1788869540.661917:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869540.662029:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545141632 00000100:00100000:1.0:1788869540.662042:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545141632 00000100:00100000:1.0:1788869540.662101:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 188 00000100:00100000:1.0:1788869540.662111:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8d0e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+9:6141:x1875765545141632:12345-192.168.201.30@tcp:101: 00010000:00010000:1.0:1788869540.662128:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869540.662146:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb95a8a00/0xbead52e175fc2bef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa8d3 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869540.662176:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb95a8a00/0xbead52e175fc2bef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa8d3 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869540.662187:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb95a8a00/0xbead52e175fc2bef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa8d3 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869540.662196:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a8a00, rc 0) 00000100:00100000:1.0:1788869540.662284:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8d0e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:6141:x1875765545141632:12345-192.168.201.30@tcp:101: Request processed in 174us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869540.662291:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 188 00000100:00100000:0.0:1788869540.665663:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869540.665776:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545141760 00000100:00100000:2.0:1788869540.665797:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545141760 00000100:00100000:2.0:1788869540.665862:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 189 00000100:00100000:2.0:1788869540.665872:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:6141:x1875765545141760:12345-192.168.201.30@tcp:501: 00000100:00100000:2.0:1788869540.666035:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:6141:x1875765545141760:12345-192.168.201.30@tcp:501: Request processed in 163us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869540.666044:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 189 00000100:00100000:0.0:1788869540.670372:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869540.670599:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545141888 00000100:00100000:2.0:1788869540.670609:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545141888 00000100:00100000:2.0:1788869540.670674:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 190 00000100:00100000:2.0:1788869540.670807:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:6141:x1875765545141888:12345-192.168.201.30@tcp:503: 00000100:00100000:2.0:1788869540.671139:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:6141:x1875765545141888:12345-192.168.201.30@tcp:503: Request processed in 455us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869540.671148:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 190 00000100:00100000:1.0:1788869540.692598:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869540.692713:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545142016 00000100:00100000:3.0:1788869540.692724:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545142016 00000100:00100000:3.0:1788869540.692783:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 191 00000100:00100000:3.0:1788869540.692793:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:6165:x1875765545142016:12345-192.168.201.30@tcp:502: 00000100:00100000:3.0:1788869540.693158:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:6165:x1875765545142016:12345-192.168.201.30@tcp:502: Request processed in 365us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869540.693167:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 191 00000100:00100000:2.0:1788869540.696444:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869540.696571:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545142144 00000100:00100000:3.0:1788869540.696580:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545142144 00000100:00100000:3.0:1788869540.696631:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 192 00000100:00100000:3.0:1788869540.696639:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:6165:x1875765545142144:12345-192.168.201.30@tcp:502: 00000100:00100000:3.0:1788869540.697006:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:6165:x1875765545142144:12345-192.168.201.30@tcp:502: Request processed in 366us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869540.697014:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 192 00000100:00100000:0.0:1788869540.711114:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869540.711163:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869540.711736:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545142272 00000100:00100000:1.0:1788869540.711748:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545142272 00000100:00100000:1.0:1788869540.711793:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545142528 00000100:00100000:1.0:1788869540.711797:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545142528 00000100:00100000:1.0:1788869540.711832:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:1.0:1788869540.711841:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2386:x1875765545142272:12345-192.168.201.30@tcp:38: 00000100:00100000:3.0:1788869540.711875:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:3.0:1788869540.711880:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2386:x1875765545142528:12345-192.168.201.30@tcp:38: 00010000:00080000:1.0:1788869540.711888:0:6485:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp t0 exp 0000000000000000 cur 158 last 0 00010000:00080000:3.0:1788869540.711893:0:6486:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:3.0:1788869540.711940:0:6486:0:(genops.c:1406:class_connect()) connect: client bf4fff62-1855-4361-a244-1a23eb291d37, cookie 0xbead52e175fc2bf6 00000020:00000080:1.0:1788869540.711962:0:6485:0:(genops.c:1406:class_connect()) connect: client bf4fff62-1855-4361-a244-1a23eb291d37, cookie 0xbead52e175fc2bfd 00000004:00100000:3.0:1788869540.711964:0:6486:0:(mdt_handler.c:7362:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000004:00100000:1.0:1788869540.711973:0:6485:0:(mdt_handler.c:7362:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788869540.712391:0:6485:0:(import.c:65:import_set_state_nolock()) ffff99fe8337c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869540.712469:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2386:x1875765545142272:12345-192.168.201.30@tcp:38: Request processed in 628us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869540.712476:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00080000:3.0:1788869540.719421:0:6486:0:(import.c:65:import_set_state_nolock()) ffff99ffbf9b0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869540.719516:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+6:2386:x1875765545142528:12345-192.168.201.30@tcp:38: Request processed in 7630us (8348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869540.719528:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00010000:00010000:2.0:1788869540.764400:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869541.729457:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869541.729587:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545142400 00000100:00100000:3.0:1788869541.729602:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545142400 00000100:00100000:3.0:1788869541.729699:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:3.0:1788869541.729712:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+6:0:x1875765545142400:12345-192.168.201.30@tcp:41: 00000100:00080000:1.0:1788869541.729718:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1788869541.729751:0:9496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788869541.729833:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+6:0:x1875765545142400:12345-192.168.201.30@tcp:41: Request processed in 124us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869541.729840:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:2.0:1788869541.729894:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869541.729945:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545142784 00000100:00100000:1.0:1788869541.730041:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545142784 00000100:00100000:1.0:1788869541.730086:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:1.0:1788869541.730094:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:6141:x1875765545142784:12345-192.168.201.30@tcp:41: 00000004:00000024:1.0:1788869541.730109:0:6485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788869541.730141:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:6141:x1875765545142784:12345-192.168.201.30@tcp:41: Request processed in 47us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869541.730148:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:0.0:1788869541.738131:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869541.738206:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545142656 00000100:00100000:3.0:1788869541.738321:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545142656 00000100:00100000:3.0:1788869541.738414:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:3.0:1788869541.738424:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:0:x1875765545142656:12345-192.168.201.30@tcp:41: 00000004:00000024:3.0:1788869541.738465:0:6484:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00080000:1.0:1788869541.738840:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869541.740185:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:0:x1875765545142656:12345-192.168.201.30@tcp:41: Request processed in 1753us (2061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869541.740197:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:1.0:1788869541.764338:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869541.764454:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545142912 00000100:00100000:0.0:1788869541.764464:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545142912 00000100:00100000:0.0:1788869541.764538:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1788869541.764549:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:6141:x1875765545142912:12345-192.168.201.30@tcp:40: 00000100:00100000:0.0:1788869541.764646:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:6141:x1875765545142912:12345-192.168.201.30@tcp:40: Request processed in 98us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869541.764654:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:2.0:1788869541.775720:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869541.775811:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869541.779989:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869541.780180:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545143296 00000100:00100000:0.0:1788869541.780191:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545143296 00000100:00100000:0.0:1788869541.780244:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:0.0:1788869541.780272:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bf4fff62-1855-4361-a244-1a23eb291d37+6:6141:x1875765545143296:12345-192.168.201.30@tcp:900: 00000100:00100000:2.0:1788869541.780406:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869541.784389:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bf4fff62-1855-4361-a244-1a23eb291d37+6:6141:x1875765545143296:12345-192.168.201.30@tcp:900: Request processed in 4125us (4398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869541.784405:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:1.0:1788869541.785069:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545143040 00000100:00100000:1.0:1788869541.785080:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545143040 00000100:00100000:1.0:1788869541.785133:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545143168 00000100:00100000:1.0:1788869541.785137:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545143168 00000100:00100000:1.0:1788869541.785155:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:1.0:1788869541.785162:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82324e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2386:x1875765545143040:12345-192.168.201.30@tcp:8: 00010000:00080000:1.0:1788869541.785192:0:8527:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:1.0:1788869541.785222:0:8527:0:(genops.c:1406:class_connect()) connect: client bf4fff62-1855-4361-a244-1a23eb291d37, cookie 0xbead52e175fc2c04 00002000:00100000:1.0:1788869541.785246:0:8527:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bf4fff62-1855-4361-a244-1a23eb291d37/ffff99fe8337a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788869541.785281:0:8527:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788869541.785643:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:0.0:1788869541.785649:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2386:x1875765545143168:12345-192.168.201.30@tcp:8: 00010000:00080000:0.0:1788869541.785669:0:8400:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:0.0:1788869541.785700:0:8400:0:(genops.c:1406:class_connect()) connect: client bf4fff62-1855-4361-a244-1a23eb291d37, cookie 0xbead52e175fc2c0b 00002000:00100000:0.0:1788869541.785706:0:8400:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bf4fff62-1855-4361-a244-1a23eb291d37/ffff99fe82cad000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788869541.785717:0:8400:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788869541.785824:0:8400:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788869541.785855:0:8400:0:(import.c:65:import_set_state_nolock()) ffff99fe82cab000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869541.785917:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2386:x1875765545143168:12345-192.168.201.30@tcp:8: Request processed in 266us (10104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869541.785926:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00002000:00080000:1.0:1788869541.786132:0:8527:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788869541.786150:0:8527:0:(import.c:65:import_set_state_nolock()) ffff99fe8337b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869541.786177:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82324e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf4fff62-1855-4361-a244-1a23eb291d37+6:2386:x1875765545143040:12345-192.168.201.30@tcp:8: Request processed in 1013us (10466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869541.786183:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:2.0:1788869541.786326:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545143424 00000100:00100000:2.0:1788869541.786332:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545143424 00000100:00100000:2.0:1788869541.786372:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 193 00000100:00100000:2.0:1788869541.786380:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2390:x1875765545143424:12345-192.168.201.30@tcp:400: 00000100:00100000:2.0:1788869541.786408:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2390:x1875765545143424:12345-192.168.201.30@tcp:400: Request processed in 30us (6003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869541.786425:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 193 00000100:00100000:2.0:1788869541.786913:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554628352:0@lo:41: 00000100:00100000:2.0:1788869541.786966:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869541.787051:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554628352 00000100:00100000:2.0:1788869541.787056:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554628352 00000100:00100000:2.0:1788869541.787081:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788869541.787088:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554628352:12345-0@lo:41: 00000004:00000024:2.0:1788869541.787109:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788869541.787148:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554628352:12345-0@lo:41: Request processed in 60us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869541.787153:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788869541.787193:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554628352:0@lo:41: 00010000:00010000:1.0:1788869541.787277:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869541.790059:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869541.790109:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869541.790280:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545143552 00000100:00100000:3.0:1788869541.790291:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545143552 00000100:00100000:3.0:1788869541.790352:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:3.0:1788869541.790364:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+6:2390:x1875765545143552:12345-192.168.201.30@tcp:400: 00000100:00100000:3.0:1788869541.790631:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+6:2390:x1875765545143552:12345-192.168.201.30@tcp:400: Request processed in 268us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869541.790640:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:0.0:1788869541.790802:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545143680 00000100:00100000:0.0:1788869541.790807:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545143680 00000100:00100000:0.0:1788869541.790843:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:0.0:1788869541.790850:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:6141:x1875765545143680:12345-192.168.201.30@tcp:33: 00000004:00080000:3.0:1788869541.817078:0:6487:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 26144us 00000004:00200000:3.0:1788869541.825703:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788869541.825816:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:6141:x1875765545143680:12345-192.168.201.30@tcp:33: Request processed in 34961us (35701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869541.825832:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:1.0:1788869542.103590:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869542.103816:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545143808 00000100:00100000:0.0:1788869542.103826:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545143808 00000100:00100000:0.0:1788869542.103892:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:0.0:1788869542.103903:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:6184:x1875765545143808:12345-192.168.201.30@tcp:101: 00010000:00010000:0.0:1788869542.103922:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869542.104001:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3c00/0xbead52e175fc2c12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa904 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869542.104083:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2400/0xbead52e175fc2c19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869542.104096:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2400/0xbead52e175fc2c19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869542.104109:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2400/0xbead52e175fc2c19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869542.104151:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788869542.104154:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869542.104171:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2400/0xbead52e175fc2c19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869542.104196:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3c00/0xbead52e175fc2c12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa904 expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869542.104214:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2400/0xbead52e175fc2c19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa904 expref: 7 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869542.104222:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fe820c1500) 00010000:00010000:0.0:1788869542.104224:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869542.104227:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb98e2400, rc 0) 00000100:00100000:0.0:1788869542.104629:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+7:6184:x1875765545143808:12345-192.168.201.30@tcp:101: Request processed in 726us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869542.104637:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:3.0:1788869542.296477:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869542.296516:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554628864:0@lo:400: 00000100:00100000:0.0:1788869542.296556:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554628608:0@lo:400: 00000100:00100000:3.0:1788869542.296584:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869542.296587:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554628736:0@lo:400: 00000100:00100000:0.0:1788869542.296622:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869542.296643:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554628480:0@lo:400: 00000100:00100000:0.0:1788869542.296643:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554629248:0@lo:400: 00000100:00100000:0.0:1788869542.296675:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869542.296678:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869542.296702:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554629376:0@lo:400: 00000100:00100000:3.0:1788869542.296732:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869542.296759:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554629888:0@lo:400: 00000100:00100000:3.0:1788869542.296780:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869542.296799:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788869542.296805:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554628992:0@lo:400: 00000100:00100000:3.0:1788869542.296824:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869542.296840:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554629504:0@lo:400: 00000100:00100000:1.0:1788869542.296848:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554628864 00000100:00100000:1.0:1788869542.296855:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554628864 00000100:00100000:3.0:1788869542.296859:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869542.296873:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554630016:0@lo:400: 00000100:00100000:3.0:1788869542.296891:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869542.296895:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554629248 00000100:00100000:1.0:1788869542.296898:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554629248 00000100:00100000:3.0:1788869542.296914:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554629376 00000100:00100000:3.0:1788869542.296917:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554629376 00000100:00100000:3.0:1788869542.296937:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554629888 00000100:00100000:3.0:1788869542.296939:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554629888 00000100:00100000:1.0:1788869542.296944:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788869542.296950:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554629504 00000100:00100000:3.0:1788869542.296952:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554629504 00000100:00100000:1.0:1788869542.296952:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554628864:12345-0@lo:400: 00000100:00100000:3.0:1788869542.296962:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554630016 00000100:00100000:3.0:1788869542.296964:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554630016 00000100:00100000:3.0:1788869542.296974:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788869542.296979:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554629376:12345-0@lo:400: 00000100:00100000:3.0:1788869542.297003:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554629376:12345-0@lo:400: Request processed in 25us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869542.297003:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554628864:12345-0@lo:400: Request processed in 52us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869542.297011:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788869542.297011:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788869542.297026:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788869542.297026:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788869542.297032:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554629888:12345-0@lo:400: 00000100:00100000:1.0:1788869542.297032:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554629248:12345-0@lo:400: 00000100:00100000:3.0:1788869542.297056:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554629888:12345-0@lo:400: Request processed in 25us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869542.297056:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554629248:12345-0@lo:400: Request processed in 25us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869542.297063:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788869542.297063:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788869542.297074:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869542.297083:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869542.297086:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554629504:12345-0@lo:400: 00000100:00100000:1.0:1788869542.297088:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554630016:12345-0@lo:400: 00000100:00100000:3.0:1788869542.297114:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554629504:12345-0@lo:400: Request processed in 29us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869542.297114:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554630016:12345-0@lo:400: Request processed in 26us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869542.297121:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869542.297141:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554628736 00000100:00100000:3.0:1788869542.297145:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554628736 00000100:00100000:3.0:1788869542.297166:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554628992 00000100:00100000:3.0:1788869542.297169:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554628992 00000100:00100000:3.0:1788869542.297179:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788869542.297184:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf95b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554628736:12345-0@lo:400: 00000100:00100000:3.0:1788869542.297213:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf95b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554628736:12345-0@lo:400: Request processed in 29us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869542.297218:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788869542.297228:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788869542.297233:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554628992:12345-0@lo:400: 00000100:00100000:3.0:1788869542.297278:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554628992:12345-0@lo:400: Request processed in 44us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869542.297283:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788869542.297331:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554628480 00000100:00100000:3.0:1788869542.297335:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554628480 00000100:00100000:3.0:1788869542.297373:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788869542.297379:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554628480:12345-0@lo:400: 00000100:00100000:3.0:1788869542.297406:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554628480:12345-0@lo:400: Request processed in 28us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869542.297412:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788869542.297419:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869542.297439:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875765554629120:0@lo:400: 00000100:00100000:2.0:1788869542.297461:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869542.297475:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875765554629632:0@lo:400: 00000100:00100000:2.0:1788869542.297493:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869542.297506:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554630144:0@lo:13: 00000100:00100000:2.0:1788869542.297530:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869542.297554:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554628608 00000100:00100000:2.0:1788869542.297557:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554628608 00000100:00100000:2.0:1788869542.297573:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554629120 00000100:00100000:2.0:1788869542.297576:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554629120 00000100:00100000:2.0:1788869542.297586:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554629632 00000100:00100000:2.0:1788869542.297589:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554629632 00000100:00100000:2.0:1788869542.297601:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788869542.297614:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554628608:12345-0@lo:400: 00000100:00080000:3.0:1788869542.297642:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869542.297646:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554628608:12345-0@lo:400: Request processed in 33us (226us total) trans 0 rc 0/0 00000100:00080000:3.0:1788869542.297647:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869542.297652:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1788869542.297654:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869542.297656:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869542.297677:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788869542.297681:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788869542.297683:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875765554629120:12345-0@lo:400: 00000100:00100000:3.0:1788869542.297687:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875765554629632:12345-0@lo:400: 00000100:00100000:3.0:1788869542.297711:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875765554629632:12345-0@lo:400: Request processed in 24us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869542.297711:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875765554629120:12345-0@lo:400: Request processed in 28us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869542.297717:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788869542.297724:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788869542.297761:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554628992:0@lo:400: 00000100:00100000:2.0:1788869542.297762:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554628608:0@lo:400: 00000100:00100000:2.0:1788869542.297772:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875765554629120:0@lo:400: 00010000:00080000:3.0:1788869542.297774:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf959c00 x1875765554629504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869542.297779:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875765554629632:0@lo:400: 00000100:00100000:3.0:1788869542.297783:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554629504:0@lo:400: 00010000:00080000:3.0:1788869542.297791:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf95bb80 x1875765554630016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869542.297799:0:3618:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1788869542.297808:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554630016:0@lo:400: 00000100:00100000:2.0:1788869542.297808:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554630144 00000100:00100000:2.0:1788869542.297811:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554630144 00010000:00080000:3.0:1788869542.297817:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf95b100 x1875765554629376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869542.297825:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554629376:0@lo:400: 00010000:00080000:3.0:1788869542.297834:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf958380 x1875765554629888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869542.297834:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788869542.297840:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1875765554630144:12345-0@lo:13: 00000100:00100000:3.0:1788869542.297841:0:3618:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788869542.297849:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554629888:0@lo:400: 00002000:00000024:2.0:1788869542.297853:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869542.297859:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554628864:0@lo:400: 00000100:00100000:3.0:1788869542.297866:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554628480:0@lo:400: 00000100:00100000:2.0:1788869542.297886:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1875765554630144:12345-0@lo:13: Request processed in 46us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869542.297891:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788869542.297919:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffb9e05500 x1875765554630144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788869542.298324:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf95b480 x1875765554629248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869542.298334:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554629248:0@lo:400: 00000100:00100000:0.0:1788869542.298341:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554629760:0@lo:400: 00000100:00100000:0.0:1788869542.298366:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869542.298402:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554628736:0@lo:400: 00000100:00100000:2.0:1788869542.298486:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554630144:0@lo:13: 00000100:00100000:3.0:1788869542.303290:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554629760 00000100:00100000:3.0:1788869542.303304:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554629760 00000100:00100000:3.0:1788869542.303417:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788869542.303427:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875765554629760:12345-0@lo:400: 00000100:00080000:2.0:1788869542.304813:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869542.304961:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875765554629760:12345-0@lo:400: Request processed in 1533us (6591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869542.304971:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788869542.306990:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788869542.314539:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf959500 x1875765554629760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869542.314571:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554629760:0@lo:400: 00000100:00100000:3.0:1788869542.810062:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869542.810098:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554630272:0@lo:13: 00010000:00010000:1.0:1788869542.810132:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869542.810201:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869542.810519:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554630272 00000100:00100000:1.0:1788869542.810529:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554630272 00000100:00100000:1.0:1788869542.810593:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788869542.810604:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554630272:12345-0@lo:13: 00002000:00000024:1.0:1788869542.810628:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869542.810731:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554630272:12345-0@lo:13: Request processed in 129us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869542.810739:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788869542.810837:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf95b480 x1875765554630272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869542.810864:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554630272:0@lo:13: 00010000:00010000:2.0:1788869543.832575:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869544.248335:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869544.248450:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545143936 00000100:00100000:3.0:1788869544.248463:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545143936 00000100:00100000:3.0:1788869544.248566:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:3.0:1788869544.248579:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+7:6236:x1875765545143936:12345-192.168.201.30@tcp:41: 00000004:00000024:3.0:1788869544.248645:0:6485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00080000:2.0:1788869544.248811:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869544.249498:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+7:6236:x1875765545143936:12345-192.168.201.30@tcp:41: Request processed in 918us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869544.249507:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:2.0:1788869544.262821:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869544.263087:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545144064 00000100:00100000:3.0:1788869544.263102:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545144064 00000100:00100000:3.0:1788869544.263203:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:3.0:1788869544.263217:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+6:6236:x1875765545144064:12345-192.168.201.30@tcp:41: 00000004:00000024:3.0:1788869544.263308:0:6486:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788869544.265109:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+6:6236:x1875765545144064:12345-192.168.201.30@tcp:41: Request processed in 1882us (2289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869544.265125:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00080000:2.0:1788869544.265278:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869544.273488:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869544.273945:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545144192 00000100:00100000:2.0:1788869544.273960:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545144192 00000100:00100000:2.0:1788869544.274063:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:2.0:1788869544.274076:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf95b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bf4fff62-1855-4361-a244-1a23eb291d37+6:6236:x1875765545144192:12345-192.168.201.30@tcp:13: 00002000:00000024:2.0:1788869544.274122:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869544.274215:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf95b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bf4fff62-1855-4361-a244-1a23eb291d37+6:6236:x1875765545144192:12345-192.168.201.30@tcp:13: Request processed in 141us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869544.274224:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00080000:3.0:1788869544.274332:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869544.280390:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869544.281003:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545144320 00000100:00100000:2.0:1788869544.281018:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545144320 00000100:00100000:2.0:1788869544.281114:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:2.0:1788869544.281127:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bf4fff62-1855-4361-a244-1a23eb291d37+6:6236:x1875765545144320:12345-192.168.201.30@tcp:13: 00002000:00000024:2.0:1788869544.281174:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869544.281310:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bf4fff62-1855-4361-a244-1a23eb291d37+6:6236:x1875765545144320:12345-192.168.201.30@tcp:13: Request processed in 185us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869544.281318:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00080000:3.0:1788869544.281457:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788869544.857461:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869544.869720:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554630400:0@lo:13: 00000100:00100000:0.0:1788869544.869825:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869544.869920:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554630400 00000100:00100000:0.0:1788869544.869931:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554630400 00000100:00100000:0.0:1788869544.870014:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788869544.870025:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf95ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554630400:12345-0@lo:13: 00002000:00000024:0.0:1788869544.870056:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869544.870111:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf95ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554630400:12345-0@lo:13: Request processed in 87us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869544.870120:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788869544.870186:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82327800 x1875765554630400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869560 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869544.870227:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554630400:0@lo:13: 00000100:00080000:3.0:1788869544.874437:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869544.875799:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869544.875836:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554630528:0@lo:13: 00000100:00100000:0.0:1788869544.875944:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869544.876071:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554630528 00000100:00100000:3.0:1788869544.876082:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554630528 00000100:00100000:3.0:1788869544.876173:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788869544.876183:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554630528:12345-0@lo:13: 00002000:00000024:3.0:1788869544.876226:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869544.876310:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554630528:12345-0@lo:13: Request processed in 128us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869544.876319:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788869544.876383:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82cb6300 x1875765554630528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869560 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869544.876407:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554630528:0@lo:13: 00000100:00080000:0.0:1788869544.876553:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869545.368582:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869545.368620:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554630656:0@lo:41: 00000100:00100000:1.0:1788869545.368694:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869545.368812:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554630656 00000100:00100000:2.0:1788869545.368821:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554630656 00000100:00100000:2.0:1788869545.368874:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788869545.368883:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554630656:12345-0@lo:41: 00000004:00000024:2.0:1788869545.368935:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869545.368987:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554630656:12345-0@lo:41: Request processed in 104us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869545.368995:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788869545.369092:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554630656:0@lo:41: 00010000:00010000:1.0:1788869545.880797:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788869545.883520:0:7415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bf4fff62-1855-4361-a244-1a23eb291d37 00000001:00100000:3.0:1788869545.883667:0:9476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bf4fff62-1855-4361-a244-1a23eb291d37 00000001:00100000:2.0:1788869545.884727:0:6463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bf4fff62-1855-4361-a244-1a23eb291d37 00000100:00100000:1.0:1788869546.904686:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554630784:0@lo:41: 00000100:00100000:1.0:1788869546.904756:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869546.904866:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554630784 00000100:00100000:2.0:1788869546.904876:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554630784 00000100:00100000:2.0:1788869546.904932:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788869546.904941:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554630784:12345-0@lo:41: 00000004:00000024:2.0:1788869546.904973:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788869546.905031:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554630784:12345-0@lo:41: Request processed in 91us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869546.905039:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788869546.905116:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554630784:0@lo:41: 00010000:00010000:0.0:1788869546.908643:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869547.115027:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869547.115119:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869547.115155:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869547.115175:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869547.115222:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869547.115599:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545144704 00000100:00100000:3.0:1788869547.115610:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545144704 00000100:00100000:3.0:1788869547.115677:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545144576 00000100:00100000:3.0:1788869547.115680:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545144576 00000100:00100000:3.0:1788869547.115703:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:3.0:1788869547.115714:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:2388:x1875765545144704:12345-192.168.201.30@tcp:400: 00000100:00100000:3.0:1788869547.115789:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:2388:x1875765545144704:12345-192.168.201.30@tcp:400: Request processed in 77us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869547.115797:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:3.0:1788869547.115814:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:3.0:1788869547.115821:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:2388:x1875765545144576:12345-192.168.201.30@tcp:400: 00000100:00100000:3.0:1788869547.115846:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:2388:x1875765545144576:12345-192.168.201.30@tcp:400: Request processed in 26us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869547.115859:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:3.0:1788869547.115878:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545144960 00000100:00100000:3.0:1788869547.115882:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545144960 00000100:00100000:3.0:1788869547.115906:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545144832 00000100:00100000:3.0:1788869547.115909:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545144832 00000100:00100000:3.0:1788869547.115927:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:3.0:1788869547.115934:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2388:x1875765545144960:12345-192.168.201.30@tcp:400: 00000100:00100000:3.0:1788869547.115958:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2388:x1875765545144960:12345-192.168.201.30@tcp:400: Request processed in 26us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869547.115963:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:3.0:1788869547.115974:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:3.0:1788869547.115979:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2388:x1875765545144832:12345-192.168.201.30@tcp:400: 00000100:00100000:3.0:1788869547.116000:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2388:x1875765545144832:12345-192.168.201.30@tcp:400: Request processed in 21us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869547.116006:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00080000:1.0:1788869547.116333:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869547.116338:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869547.116341:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869547.116342:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869547.119407:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545144448 00000100:00100000:2.0:1788869547.119421:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545144448 00000100:00100000:3.0:1788869547.119623:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 195 00000100:00100000:3.0:1788869547.119634:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2388:x1875765545144448:12345-192.168.201.30@tcp:400: 00000100:00100000:3.0:1788869547.119705:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2388:x1875765545144448:12345-192.168.201.30@tcp:400: Request processed in 72us (4692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869547.119712:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 195 00000001:02000400:3.0:1788869547.144894:0:10151:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788869547.416657:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554631040:0@lo:400: 00000100:00100000:1.0:1788869547.416741:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869547.416805:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554631552:0@lo:400: 00000100:00100000:1.0:1788869547.416827:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869547.416851:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875765554632064:0@lo:400: 00000100:00100000:1.0:1788869547.416874:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869547.416896:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788869547.416902:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554630912:0@lo:400: 00000100:00100000:1.0:1788869547.416928:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869547.416944:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554631424:0@lo:400: 00000100:00100000:1.0:1788869547.416964:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869547.416979:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554631936:0@lo:400: 00000100:00100000:1.0:1788869547.416998:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869547.417013:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554632448:0@lo:400: 00000100:00100000:1.0:1788869547.417030:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869547.417053:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554631296:0@lo:400: 00000100:00100000:1.0:1788869547.417074:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869547.417091:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554631808:0@lo:400: 00000100:00100000:1.0:1788869547.417110:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869547.417125:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554632320:0@lo:400: 00000100:00100000:1.0:1788869547.417147:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869547.417171:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788869547.417177:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554631168:0@lo:400: 00000100:00100000:1.0:1788869547.417197:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869547.417214:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554631680:0@lo:400: 00000100:00100000:1.0:1788869547.417234:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869547.417244:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554632192:0@lo:400: 00000100:00100000:1.0:1788869547.417297:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869547.417321:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554631040 00000100:00100000:1.0:1788869547.417328:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554631040 00000100:00100000:1.0:1788869547.417362:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554631552 00000100:00100000:1.0:1788869547.417366:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554631552 00000100:00100000:1.0:1788869547.417389:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554632064 00000100:00100000:1.0:1788869547.417391:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554632064 00000100:00100000:1.0:1788869547.417402:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554631296 00000100:00100000:1.0:1788869547.417404:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554631296 00000100:00100000:1.0:1788869547.417429:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554631680 00000100:00100000:1.0:1788869547.417432:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554631680 00000100:00100000:1.0:1788869547.417445:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554632192 00000100:00100000:1.0:1788869547.417447:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554632192 00000100:00100000:1.0:1788869547.417462:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788869547.417470:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554631040:12345-0@lo:400: 00000100:00100000:1.0:1788869547.417516:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554631040:12345-0@lo:400: Request processed in 47us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869547.417524:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788869547.417541:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788869547.417547:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554631552:12345-0@lo:400: 00000100:00100000:1.0:1788869547.417597:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554631552:12345-0@lo:400: Request processed in 50us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869547.417603:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788869547.417619:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788869547.417624:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875765554632064:12345-0@lo:400: 00000100:00100000:1.0:1788869547.417648:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875765554632064:12345-0@lo:400: Request processed in 24us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869547.417653:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788869547.417662:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788869547.417667:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554631296:12345-0@lo:400: 00000100:00100000:1.0:1788869547.417692:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554631296:12345-0@lo:400: Request processed in 25us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869547.417698:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788869547.417708:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788869547.417714:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554631680:12345-0@lo:400: 00000100:00100000:1.0:1788869547.417738:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554631680:12345-0@lo:400: Request processed in 25us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869547.417743:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788869547.417753:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788869547.417759:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875765554632192:12345-0@lo:400: 00000100:00100000:1.0:1788869547.417782:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875765554632192:12345-0@lo:400: Request processed in 23us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869547.417787:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788869547.417807:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554631424 00000100:00100000:1.0:1788869547.417810:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554631424 00000100:00100000:1.0:1788869547.417829:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554631168 00000100:00100000:1.0:1788869547.417832:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554631168 00000100:00100000:1.0:1788869547.417842:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788869547.417847:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554631424:12345-0@lo:400: 00000100:00100000:1.0:1788869547.417876:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554631424:12345-0@lo:400: Request processed in 29us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869547.417888:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788869547.417899:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788869547.417904:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554631168:12345-0@lo:400: 00000100:00100000:1.0:1788869547.417929:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554631168:12345-0@lo:400: Request processed in 26us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869547.417934:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788869547.417950:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554631936 00000100:00100000:1.0:1788869547.417954:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554631936 00000100:00100000:1.0:1788869547.417970:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554632448 00000100:00100000:1.0:1788869547.417972:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554632448 00000100:00100000:1.0:1788869547.417984:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554631808 00000100:00100000:1.0:1788869547.417986:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554631808 00000100:00100000:1.0:1788869547.417995:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554632320 00000100:00100000:1.0:1788869547.417997:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554632320 00000100:00100000:1.0:1788869547.418008:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788869547.418013:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554631936:12345-0@lo:400: 00000100:00100000:1.0:1788869547.418041:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554631936:12345-0@lo:400: Request processed in 28us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869547.418047:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788869547.418057:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788869547.418062:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554632448:12345-0@lo:400: 00000100:00100000:1.0:1788869547.418088:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554632448:12345-0@lo:400: Request processed in 26us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869547.418093:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788869547.418103:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788869547.418109:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554631808:12345-0@lo:400: 00000100:00100000:1.0:1788869547.418133:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554631808:12345-0@lo:400: Request processed in 25us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869547.418145:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788869547.418156:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788869547.418161:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554632320:12345-0@lo:400: 00000100:00100000:1.0:1788869547.418187:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554632320:12345-0@lo:400: Request processed in 26us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869547.418193:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1788869547.418221:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869547.418225:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869547.418228:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869547.418229:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869547.418283:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554631168:0@lo:400: 00010000:00080000:1.0:1788869547.418300:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf959500 x1875765554631680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869547.418309:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554631680:0@lo:400: 00010000:00080000:1.0:1788869547.418320:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf959c00 x1875765554632192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869547.418327:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554632192:0@lo:400: 00000100:00100000:1.0:1788869547.418337:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554631296:0@lo:400: 00010000:00080000:1.0:1788869547.418346:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf958380 x1875765554631808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869547.418353:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554631808:0@lo:400: 00010000:00080000:1.0:1788869547.418361:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf95a300 x1875765554632320/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869547.418369:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554632320:0@lo:400: 00000100:00100000:1.0:1788869547.418419:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554631424:0@lo:400: 00010000:00080000:1.0:1788869547.418428:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf95b100 x1875765554631936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869547.418436:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554631936:0@lo:400: 00010000:00080000:1.0:1788869547.418444:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf901f80 x1875765554632448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869547.418452:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554632448:0@lo:400: 00000100:00100000:1.0:1788869547.418462:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554631040:0@lo:400: 00000100:00100000:1.0:1788869547.418471:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554631552:0@lo:400: 00000100:00100000:1.0:1788869547.418479:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875765554632064:0@lo:400: 00000100:00100000:3.0:1788869547.418795:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554630912 00000100:00100000:3.0:1788869547.418801:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554630912 00000100:00100000:3.0:1788869547.418845:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788869547.418851:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:3619:x1875765554630912:12345-0@lo:400: 00000100:00100000:3.0:1788869547.418911:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:3619:x1875765554630912:12345-0@lo:400: Request processed in 60us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869547.418918:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788869547.418963:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554630912:0@lo:400: 00000100:00100000:0.0:1788869547.419312:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869547.422907:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554632576:0@lo:13: 00000100:00100000:0.0:1788869547.422989:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869547.424308:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554632576 00000100:00100000:3.0:1788869547.424320:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554632576 00000100:00100000:3.0:1788869547.424382:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788869547.424392:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf900e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554632576:12345-0@lo:13: 00002000:00000024:3.0:1788869547.424427:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869547.424518:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf900e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554632576:12345-0@lo:13: Request processed in 127us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869547.424526:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788869547.424985:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83836680 x1875765554632576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869547.425006:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554632576:0@lo:13: 00000100:00100000:0.0:1788869547.928587:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554632704:0@lo:13: 00000100:00100000:0.0:1788869547.928658:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869547.929905:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554632704 00000100:00100000:3.0:1788869547.929915:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554632704 00000100:00100000:3.0:1788869547.929968:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788869547.929978:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf900a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554632704:12345-0@lo:13: 00002000:00000024:3.0:1788869547.930001:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869547.930073:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf900a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554632704:12345-0@lo:13: Request processed in 97us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869547.930081:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1788869547.930133:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1788869547.930162:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf902680 x1875765554632704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869547.930181:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554632704:0@lo:13: 00000001:00100000:0.0:1788869547.931982:0:8393:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bf4fff62-1855-4361-a244-1a23eb291d37 00010000:00010000:1.0:1788869548.952580:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869549.977663:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554632832:0@lo:13: 00000100:00100000:1.0:1788869549.977735:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869549.977806:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554632832 00000100:00100000:1.0:1788869549.977813:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554632832 00000100:00100000:1.0:1788869549.977863:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788869549.977872:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554632832:12345-0@lo:13: 00002000:00000024:1.0:1788869549.977903:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869549.977949:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554632832:12345-0@lo:13: Request processed in 78us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869549.977973:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788869549.977993:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869549.978025:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83836680 x1875765554632832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869565 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869549.978045:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554632832:0@lo:13: 00010000:00010000:2.0:1788869549.981368:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869549.981442:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869549.981464:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554632960:0@lo:13: 00000100:00100000:2.0:1788869549.981543:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869549.981751:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554632960 00000100:00100000:1.0:1788869549.981760:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554632960 00000100:00100000:1.0:1788869549.981833:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788869549.981843:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554632960:12345-0@lo:13: 00002000:00000024:1.0:1788869549.981868:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869549.981933:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554632960:12345-0@lo:13: Request processed in 92us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869549.981941:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788869549.981986:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82327800 x1875765554632960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869565 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869549.982006:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554632960:0@lo:13: 00000100:00080000:0.0:1788869549.982286:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1788869550.347553:0:10299:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd68ff97f0 20000000:00000080:1.0:1788869550.347573:0:10299:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99ffb99e0800 uarg=0000000000000000 20000000:01000000:1.0:1788869550.347615:0:10299:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788869550.347618:0:10299:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788869550.347620:0:10299:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788869550.347625:0:10299:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788869550.347630:0:10299:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788869550.347691:0:10299:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788869550.347694:0:10299:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788869550.351516:0:10300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1788869550.351833:0:10299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1788869550.351864:0:10299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1788869550.351890:0:10299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1788869550.351901:0:10299:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788869550.351904:0:10299:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788869550.356617:0:10301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1788869550.357154:0:10299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1788869550.357188:0:10299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1788869550.357203:0:10299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1788869550.357215:0:10299:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788869550.357218:0:10299:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788869550.358230:0:10302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1788869550.358551:0:10299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1788869550.358578:0:10299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1788869550.358592:0:10299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1788869550.358603:0:10299:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788869550.358605:0:10299:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788869550.359022:0:10303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1788869550.359533:0:10299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1788869550.359557:0:10299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1788869550.359572:0:10299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1788869550.359581:0:10299:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788869550.359583:0:10299:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788869550.360518:0:10304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1788869550.364174:0:10299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1788869550.364216:0:10299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1788869550.364233:0:10299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:3.0:1788869550.364249:0:10299:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788869550.364658:0:10299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2c20 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.364677:0:10299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb98e2000/0xbead52e175fc2abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2ab4 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.364686:0:10299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2ade expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.364692:0:10299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ff81534800/0xbead52e175fc2b24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2b1d expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.364710:0:10299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb98e3600/0xbead52e175fc2b32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2b2b expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.364717:0:10299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb95a9800/0xbead52e175fc2b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2b39 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.364724:0:10299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb98e2800/0xbead52e175fc2b5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2b55 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.364731:0:10299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ff81534e00/0xbead52e175fc2b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2b7f expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.364739:0:10299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2ba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2b9b expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.364745:0:10299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb9a9e400/0xbead52e175fc2bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2bc5 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.364754:0:10299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb9a9fc00/0xbead52e175fc2bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa894 expref: 9 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.364761:0:10299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ff81535200/0xbead52e175fc2be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa89b expref: 9 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.364840:0:10299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2c20 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.364884:0:10299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ff81535200/0xbead52e175fc2be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa89b expref: 9 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.364911:0:10299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ff81535200/0xbead52e175fc2be1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa89b expref: 9 pid: 6476 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869550.364927:0:10299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10299:1875765554633088:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869550.365032:0:10299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb9a9fc00/0xbead52e175fc2bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa894 expref: 9 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.365041:0:10299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffb9a9fc00/0xbead52e175fc2bda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa894 expref: 9 pid: 6476 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869550.365050:0:10299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10299:1875765554633216:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869550.365077:0:10299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb9a9e400/0xbead52e175fc2bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2bc5 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.365084:0:10299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffb9a9e400/0xbead52e175fc2bcc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2bc5 expref: 23 pid: 6479 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869550.365094:0:10299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10299:1875765554633344:0@lo:104: 00000100:00100000:3.0:1788869550.365133:0:10299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869550.365164:0:10299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2ba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2b9b expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.365172:0:10299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2ba2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2b9b expref: 23 pid: 6476 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869550.365179:0:10299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10299:1875765554633472:0@lo:104: 00000100:00100000:3.0:1788869550.365200:0:10299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869550.365336:0:10299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ff81534e00/0xbead52e175fc2b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2b7f expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.365345:0:10299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ff81534e00/0xbead52e175fc2b86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2b7f expref: 23 pid: 6478 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869550.365353:0:10299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10299:1875765554633600:0@lo:104: 00000100:00100000:3.0:1788869550.365374:0:10299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869550.366227:0:10299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb98e2800/0xbead52e175fc2b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2b55 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.366239:0:10299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffb98e2800/0xbead52e175fc2b5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2b55 expref: 23 pid: 6479 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869550.366249:0:10299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10299:1875765554633728:0@lo:104: 00000100:00100000:3.0:1788869550.366300:0:10299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869550.374019:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554633344 00000100:00100000:0.0:1788869550.374035:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554633344 00000100:00100000:0.0:1788869550.374918:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869550.374950:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545145088 00000100:00100000:0.0:1788869550.374955:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545145088 00010000:00010000:0.0:1788869550.374988:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ff81535200/0xbead52e175fc2be1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa89b expref: 10 pid: 6476 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869550.375027:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:0.0:1788869550.375036:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89da8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2387:x1875765545145088:12345-192.168.201.30@tcp:103: 00010000:00010000:0.0:1788869550.375051:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869550.375066:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ff81535200/0xbead52e175fc2be1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa89b expref: 10 pid: 6476 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869550.375079:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ff81535200/0xbead52e175fc2be1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa89b expref: 10 pid: 6476 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869550.375100:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869550.375151:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89da8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2387:x1875765545145088:12345-192.168.201.30@tcp:103: Request processed in 116us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869550.375159:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:2.0:1788869550.375528:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554633472 00000100:00100000:2.0:1788869550.375534:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554633472 00000100:00100000:2.0:1788869550.375561:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554633600 00000100:00100000:2.0:1788869550.375563:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554633600 00000100:00100000:2.0:1788869550.375575:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788869550.375580:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+5:10299:x1875765554633472:12345-0@lo:104: 00010000:00010000:2.0:1788869550.375593:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2b9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2ba2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.375652:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788869550.375658:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+5:10299:x1875765554633472:12345-0@lo:104: Request processed in 78us (10457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869550.375664:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788869550.375678:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788869550.375683:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+4:10299:x1875765554633600:12345-0@lo:104: 00010000:00010000:2.0:1788869550.375690:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc2b7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2b86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.375720:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788869550.375724:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+4:10299:x1875765554633600:12345-0@lo:104: Request processed in 42us (10350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869550.375730:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1788869550.375748:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869550.375753:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2b9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2ba2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.375770:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a8800 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1788869550.375775:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2b9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2ba2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.375784:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2ba2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869550.375791:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2ba2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869550.375797:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869550.375835:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2b9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2ba2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.375841:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869550.375875:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2b9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2ba2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.375883:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2b9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2ba2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.375897:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869550.375901:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc2b7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2b86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.375907:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9f400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1788869550.375910:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc2b7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2b86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.375917:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc2b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2b86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869550.375923:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc2b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2b86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869550.375928:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869550.375941:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc2b7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2b86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.375946:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869550.375959:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc2b7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2b86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.375975:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc2b7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2b86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.375985:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869550.375987:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869550.375988:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869550.375994:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869550.376007:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554633856:0@lo:103: 00000100:00100000:2.0:1788869550.376037:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869550.376081:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554633984:0@lo:103: 00000100:00100000:2.0:1788869550.376100:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869550.376126:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554633856 00000100:00100000:2.0:1788869550.376129:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554633856 00010000:00010000:2.0:1788869550.376142:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2ba2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2b9b expref: 24 pid: 6476 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869550.376158:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554633984 00000100:00100000:2.0:1788869550.376160:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554633984 00010000:00010000:2.0:1788869550.376169:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ff81534e00/0xbead52e175fc2b86 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2b7f expref: 25 pid: 6478 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869550.376182:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788869550.376188:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+25:3619:x1875765554633856:12345-0@lo:103: 00010000:00010000:2.0:1788869550.376197:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869550.376201:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2ba2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2b9b expref: 25 pid: 6476 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.376209:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2ba2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2b9b expref: 25 pid: 6476 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.376227:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869550.376278:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+25:3619:x1875765554633856:12345-0@lo:103: Request processed in 91us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869550.376284:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788869550.376298:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788869550.376303:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3616:x1875765554633984:12345-0@lo:103: 00010000:00010000:2.0:1788869550.376310:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869550.376314:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ff81534e00/0xbead52e175fc2b86 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2b7f expref: 24 pid: 6478 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.376322:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ff81534e00/0xbead52e175fc2b86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2b7f expref: 24 pid: 6478 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.376330:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869550.376355:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3616:x1875765554633984:12345-0@lo:103: Request processed in 52us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869550.376361:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788869550.377001:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554633984:0@lo:103: 00000100:00100000:2.0:1788869550.377052:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554633856:0@lo:103: 00000100:00100000:1.0:1788869550.377380:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788869550.377390:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+3:10299:x1875765554633344:12345-0@lo:104: 00010000:00010000:1.0:1788869550.377402:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2600/0xbead52e175fc2bc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2bcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869550.377459:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788869550.377464:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+3:10299:x1875765554633344:12345-0@lo:104: Request processed in 77us (12332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869550.377470:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788869550.377717:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869550.377722:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2600/0xbead52e175fc2bc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2bcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.377730:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb98e2600 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1788869550.377733:0:7425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2600/0xbead52e175fc2bc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2bcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.377756:0:7425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2600/0xbead52e175fc2bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2bcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869550.377764:0:7425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2600/0xbead52e175fc2bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2bcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869550.377769:0:7425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869550.377801:0:7425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2600/0xbead52e175fc2bc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2bcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.377807:0:7425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869550.377831:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2600/0xbead52e175fc2bc5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2bcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.377838:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2600/0xbead52e175fc2bc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2bcc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.377848:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869550.377849:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869550.377851:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869550.377857:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869550.377867:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554634112:0@lo:103: 00000100:00100000:2.0:1788869550.377899:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869550.377933:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554634112 00000100:00100000:2.0:1788869550.377938:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554634112 00010000:00010000:2.0:1788869550.377956:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb9a9e400/0xbead52e175fc2bcc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2bc5 expref: 24 pid: 6479 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869550.377974:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788869550.377979:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3616:x1875765554634112:12345-0@lo:103: 00010000:00010000:2.0:1788869550.377995:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869550.378000:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb9a9e400/0xbead52e175fc2bcc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2bc5 expref: 24 pid: 6479 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.378008:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb9a9e400/0xbead52e175fc2bcc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2bc5 expref: 24 pid: 6479 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.378021:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869550.378046:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3616:x1875765554634112:12345-0@lo:103: Request processed in 67us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869550.378051:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788869550.378082:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554634112:0@lo:103: 00010000:00010000:3.0:1788869550.378499:0:10299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb95a9800/0xbead52e175fc2b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2b39 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.378511:0:10299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffb95a9800/0xbead52e175fc2b40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2b39 expref: 23 pid: 6476 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869550.378521:0:10299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10299:1875765554634240:0@lo:104: 00010000:00010000:3.0:1788869550.378551:0:10299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb98e3600/0xbead52e175fc2b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2b2b expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.378559:0:10299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffb98e3600/0xbead52e175fc2b32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2b2b expref: 23 pid: 6479 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869550.378567:0:10299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10299:1875765554634368:0@lo:104: 00010000:00010000:3.0:1788869550.378601:0:10299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ff81534800/0xbead52e175fc2b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2b1d expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.378609:0:10299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ff81534800/0xbead52e175fc2b24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2b1d expref: 23 pid: 6478 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869550.378617:0:10299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10299:1875765554634496:0@lo:104: 00010000:00010000:3.0:1788869550.378640:0:10299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2ade expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.378648:0:10299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2ae5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2ade expref: 23 pid: 6476 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869550.378656:0:10299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10299:1875765554634624:0@lo:104: 00010000:00010000:3.0:1788869550.378678:0:10299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb98e2000/0xbead52e175fc2abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2ab4 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869550.378686:0:10299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffb98e2000/0xbead52e175fc2abb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2ab4 expref: 23 pid: 6476 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869550.378693:0:10299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10299:1875765554634752:0@lo:104: 00000100:00100000:3.0:1788869550.378710:0:10299:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82320900 going to sleep for 11 seconds 00010000:00010000:3.0:1788869550.378727:0:10299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff81535200/0xbead52e175fc2be1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa89b expref: 9 pid: 6476 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869550.378739:0:10299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10299:1875765554633088:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869550.378749:0:10299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10299:1875765554633216:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869550.378757:0:10299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb9a9e400/0xbead52e175fc2bcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2bc5 expref: 23 pid: 6479 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869550.378773:0:10299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10299:1875765554633344:0@lo:104: 00010000:00010000:3.0:1788869550.378785:0:10299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2ba2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2b9b expref: 22 pid: 6476 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869550.378793:0:10299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10299:1875765554633472:0@lo:104: 00010000:00010000:3.0:1788869550.378802:0:10299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff81534e00/0xbead52e175fc2b86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2b7f expref: 21 pid: 6478 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869550.378809:0:10299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10299:1875765554633600:0@lo:104: 00000100:00100000:2.0:1788869550.378873:0:6468:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788869550.378891:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869550.378914:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869550.378928:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869550.378937:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869550.378944:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869550.378952:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554633728 00000100:00100000:2.0:1788869550.378957:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554633728 00000100:00100000:2.0:1788869550.378977:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554634240 00000100:00100000:2.0:1788869550.378980:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554634240 00000100:00100000:2.0:1788869550.378989:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554634368 00000100:00100000:2.0:1788869550.378991:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554634368 00000100:00100000:2.0:1788869550.378999:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554634496 00000100:00100000:2.0:1788869550.379002:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554634496 00000100:00100000:2.0:1788869550.379008:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554634624 00000100:00100000:2.0:1788869550.379011:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554634624 00000100:00100000:2.0:1788869550.379018:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554634752 00000100:00100000:2.0:1788869550.379020:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554634752 00000100:00100000:2.0:1788869550.379031:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788869550.379058:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf989450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+8:10299:x1875765554633728:12345-0@lo:104: 00010000:00010000:2.0:1788869550.379068:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2b55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2b5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379121:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788869550.379126:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf989450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+8:10299:x1875765554633728:12345-0@lo:104: Request processed in 71us (12826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869550.379133:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788869550.379167:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788869550.379173:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+7:10299:x1875765554634240:12345-0@lo:104: 00010000:00010000:2.0:1788869550.379180:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2b40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379211:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788869550.379216:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+7:10299:x1875765554634240:12345-0@lo:104: Request processed in 44us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869550.379223:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788869550.379235:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788869550.379240:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+6:10299:x1875765554634368:12345-0@lo:104: 00010000:00010000:2.0:1788869550.379247:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2b32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379299:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788869550.379304:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+6:10299:x1875765554634368:12345-0@lo:104: Request processed in 65us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869550.379310:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788869550.379322:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788869550.379333:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+5:10299:x1875765554634496:12345-0@lo:104: 00010000:00010000:2.0:1788869550.379341:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2b24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379367:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788869550.379371:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+5:10299:x1875765554634496:12345-0@lo:104: Request processed in 39us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869550.379376:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788869550.379388:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788869550.379393:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+4:10299:x1875765554634624:12345-0@lo:104: 00010000:00010000:2.0:1788869550.379399:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9000/0xbead52e175fc2ade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2ae5 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379422:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788869550.379427:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+4:10299:x1875765554634624:12345-0@lo:104: Request processed in 35us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869550.379432:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788869550.379443:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788869550.379449:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+3:10299:x1875765554634752:12345-0@lo:104: 00010000:00010000:2.0:1788869550.379455:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2ab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2abb expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379479:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788869550.379484:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+3:10299:x1875765554634752:12345-0@lo:104: Request processed in 36us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869550.379501:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1788869550.379518:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788869550.379528:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2b55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2b5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379535:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fa00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1788869550.379538:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2b55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2b5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379546:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2b55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2b5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869550.379554:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2b55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2b5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869550.379560:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869550.379582:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2b55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2b5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379588:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869550.379603:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2b55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2b5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379609:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2b55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2b5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379620:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788869550.379624:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2b40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379630:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9ea00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1788869550.379632:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2b40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379649:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2b39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2b40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869550.379654:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2b39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2b40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869550.379659:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869550.379671:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2b39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2b40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379676:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869550.379681:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2b39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2b40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379688:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc2b39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2b40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379698:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788869550.379701:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2b32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379707:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a8c00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1788869550.379709:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2b32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379716:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2b2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2b32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869550.379722:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2b2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2b32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869550.379733:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869550.379747:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2b2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2b32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379753:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869550.379766:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2b2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2b32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379773:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2b2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2b32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379783:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788869550.379786:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2b24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379792:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9ee00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1788869550.379794:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2b24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379801:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2b1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2b24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869550.379807:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2b1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2b24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869550.379813:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869550.379823:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2b1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2b24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379829:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869550.379841:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2b1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2b24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379847:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ee00/0xbead52e175fc2b1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2b24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379855:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869550.379858:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9000/0xbead52e175fc2ade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2ae5 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379864:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a9000 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1788869550.379866:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9000/0xbead52e175fc2ade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2ae5 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379873:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9000/0xbead52e175fc2ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2ae5 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869550.379880:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9000/0xbead52e175fc2ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2ae5 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869550.379885:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869550.379897:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9000/0xbead52e175fc2ade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2ae5 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379902:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869550.379905:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9000/0xbead52e175fc2ade lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2ae5 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379911:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9000/0xbead52e175fc2ade lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2ae5 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379919:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869550.379927:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2ab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2abb expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379932:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535800 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1788869550.379935:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2ab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2abb expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379940:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2abb expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869550.379946:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2abb expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869550.379951:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869550.379964:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2ab4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2abb expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379969:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869550.379974:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2ab4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2abb expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379979:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2ab4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2abb expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.379992:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869550.379994:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869550.379996:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869550.380007:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554635264:0@lo:103: 00000100:00100000:2.0:1788869550.380037:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869550.380057:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869550.380062:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554635136:0@lo:103: 00000100:00100000:2.0:1788869550.380089:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869550.380112:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554634880:0@lo:103: 00000100:00100000:2.0:1788869550.380132:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869550.380148:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554635392:0@lo:103: 00000100:00100000:2.0:1788869550.380170:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869550.380185:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788869550.380190:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554635008:0@lo:103: 00000100:00100000:2.0:1788869550.380209:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869550.380225:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8208a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554635520:0@lo:103: 00000100:00100000:2.0:1788869550.380244:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869550.380286:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554635264 00000100:00100000:2.0:1788869550.380291:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554635264 00010000:00010000:2.0:1788869550.380309:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ff81534800/0xbead52e175fc2b24 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2b1d expref: 21 pid: 6478 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869550.380324:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554635136 00000100:00100000:2.0:1788869550.380326:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554635136 00010000:00010000:2.0:1788869550.380334:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb98e3600/0xbead52e175fc2b32 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2b2b expref: 22 pid: 6479 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869550.380342:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554634880 00000100:00100000:2.0:1788869550.380344:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554634880 00010000:00010000:2.0:1788869550.380352:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb98e2800/0xbead52e175fc2b5c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2b55 expref: 23 pid: 6479 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869550.380360:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554635392 00000100:00100000:2.0:1788869550.380362:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554635392 00010000:00010000:2.0:1788869550.380385:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2ae5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2ade expref: 24 pid: 6476 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869550.380406:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554635008 00000100:00100000:2.0:1788869550.380409:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554635008 00010000:00010000:2.0:1788869550.380418:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb95a9800/0xbead52e175fc2b40 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2b39 expref: 25 pid: 6476 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869550.380426:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554635520 00000100:00100000:2.0:1788869550.380428:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554635520 00010000:00010000:2.0:1788869550.380436:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb98e2000/0xbead52e175fc2abb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2ab4 expref: 26 pid: 6476 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869550.380447:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788869550.380453:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8208a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46892796-b77d-4866-a7cc-ce4160dea4be+26:3617:x1875765554635264:12345-0@lo:103: 00010000:00010000:2.0:1788869550.380462:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869550.380468:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ff81534800/0xbead52e175fc2b24 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2b1d expref: 26 pid: 6478 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.380477:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ff81534800/0xbead52e175fc2b24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2b1d expref: 26 pid: 6478 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.380507:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869550.380536:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8208a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46892796-b77d-4866-a7cc-ce4160dea4be+26:3617:x1875765554635264:12345-0@lo:103: Request processed in 83us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869550.380543:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788869550.380557:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788869550.380562:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8208aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46892796-b77d-4866-a7cc-ce4160dea4be+25:3617:x1875765554635136:12345-0@lo:103: 00010000:00010000:2.0:1788869550.380568:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869550.380572:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb98e3600/0xbead52e175fc2b32 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2b2b expref: 25 pid: 6479 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.380588:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb98e3600/0xbead52e175fc2b32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2b2b expref: 25 pid: 6479 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.380597:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869550.380616:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8208aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46892796-b77d-4866-a7cc-ce4160dea4be+25:3617:x1875765554635136:12345-0@lo:103: Request processed in 55us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869550.380622:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788869550.380634:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788869550.380639:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82089c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554634880:12345-0@lo:103: 00010000:00010000:2.0:1788869550.380645:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869550.380649:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb98e2800/0xbead52e175fc2b5c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2b55 expref: 24 pid: 6479 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.380656:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb98e2800/0xbead52e175fc2b5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2b55 expref: 24 pid: 6479 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.380664:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869550.380686:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82089c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554634880:12345-0@lo:103: Request processed in 47us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869550.380691:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788869550.380702:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788869550.380707:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46892796-b77d-4866-a7cc-ce4160dea4be+23:3618:x1875765554635392:12345-0@lo:103: 00010000:00010000:2.0:1788869550.380713:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869550.380716:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2ae5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2ade expref: 23 pid: 6476 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.380723:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2ae5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2ade expref: 23 pid: 6476 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.380737:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869550.380759:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46892796-b77d-4866-a7cc-ce4160dea4be+23:3618:x1875765554635392:12345-0@lo:103: Request processed in 52us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869550.380765:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788869550.380794:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788869550.380799:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8208b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46892796-b77d-4866-a7cc-ce4160dea4be+22:3618:x1875765554635008:12345-0@lo:103: 00010000:00010000:2.0:1788869550.380806:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869550.380810:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb95a9800/0xbead52e175fc2b40 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2b39 expref: 22 pid: 6476 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.380818:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb95a9800/0xbead52e175fc2b40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2b39 expref: 22 pid: 6476 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.380826:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869550.380845:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8208b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46892796-b77d-4866-a7cc-ce4160dea4be+22:3618:x1875765554635008:12345-0@lo:103: Request processed in 47us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869550.380851:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788869550.380861:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788869550.380867:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8208ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46892796-b77d-4866-a7cc-ce4160dea4be+21:3618:x1875765554635520:12345-0@lo:103: 00010000:00010000:2.0:1788869550.380873:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869550.380877:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb98e2000/0xbead52e175fc2abb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2ab4 expref: 21 pid: 6476 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.380884:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb98e2000/0xbead52e175fc2abb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2ab4 expref: 21 pid: 6476 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.380893:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869550.380918:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8208ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46892796-b77d-4866-a7cc-ce4160dea4be+21:3618:x1875765554635520:12345-0@lo:103: Request processed in 51us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869550.380924:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788869550.380963:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554635136:0@lo:103: 00000100:00100000:2.0:1788869550.380982:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554635264:0@lo:103: 00010000:00010000:2.0:1788869550.381002:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869550.381014:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554635008:0@lo:103: 00000100:00100000:2.0:1788869550.381020:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8208a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554635520:0@lo:103: 00000100:00100000:2.0:1788869550.381027:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554634880:0@lo:103: 00000100:00100000:2.0:1788869550.381033:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554635392:0@lo:103: 00010000:00010000:2.0:1788869550.381049:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869550.381289:0:10299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb98e2800/0xbead52e175fc2b5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2b55 expref: 20 pid: 6479 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869550.381299:0:10299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10299:1875765554633728:0@lo:104: 00010000:00010000:3.0:1788869550.381308:0:10299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb95a9800/0xbead52e175fc2b40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2b39 expref: 19 pid: 6476 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869550.381315:0:10299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10299:1875765554634240:0@lo:104: 00010000:00010000:3.0:1788869550.381323:0:10299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb98e3600/0xbead52e175fc2b32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2b2b expref: 18 pid: 6479 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869550.381329:0:10299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10299:1875765554634368:0@lo:104: 00010000:00010000:3.0:1788869550.381336:0:10299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff81534800/0xbead52e175fc2b24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2b1d expref: 17 pid: 6478 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869550.381344:0:10299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10299:1875765554634496:0@lo:104: 00010000:00010000:3.0:1788869550.381351:0:10299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2ae5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2ade expref: 16 pid: 6476 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869550.381365:0:10299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10299:1875765554634624:0@lo:104: 00010000:00010000:3.0:1788869550.381374:0:10299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb98e2000/0xbead52e175fc2abb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2ab4 expref: 15 pid: 6476 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869550.381380:0:10299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10299:1875765554634752:0@lo:104: 00010000:00010000:3.0:1788869550.381418:0:10299:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2c20 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869550.385510:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869550.385637:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545145216 00000100:00100000:2.0:1788869550.385647:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545145216 00010000:00010000:2.0:1788869550.385684:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb9a9fc00/0xbead52e175fc2bda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa894 expref: 9 pid: 6476 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869550.385732:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:2.0:1788869550.385742:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3df077ce-aecd-4e92-8493-7099e13a8f7b+9:2388:x1875765545145216:12345-192.168.201.30@tcp:103: 00010000:00010000:2.0:1788869550.385757:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869550.385763:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb9a9fc00/0xbead52e175fc2bda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa894 expref: 9 pid: 6476 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.385776:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb9a9fc00/0xbead52e175fc2bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa894 expref: 9 pid: 6476 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.385794:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb9a9fc00/0xbead52e175fc2bda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa894 expref: 9 pid: 6476 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.385823:0:9488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2c20 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.385831:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2c20 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.385847:0:9488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2c20 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.385853:0:9488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2c20 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.385860:0:9488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2c20 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.385866:0:9488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2c20 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.385873:0:9488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9e800 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869550.385877:0:9488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2c20 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.385885:0:9488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2c20 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869550.388611:0:10299:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2c20 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869550.388630:0:10299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2c20 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.391451:0:9488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2c20 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.391473:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2c20 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869550.391515:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869550.391640:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3df077ce-aecd-4e92-8493-7099e13a8f7b+8:2388:x1875765545145216:12345-192.168.201.30@tcp:103: Request processed in 5895us (6146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869550.391652:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:2.0:1788869550.495569:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869550.495593:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8208a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554635648:0@lo:41: 00000100:00100000:2.0:1788869550.495664:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869550.495751:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554635648 00000100:00100000:1.0:1788869550.495758:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554635648 00000100:00100000:1.0:1788869550.495808:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788869550.495817:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8208a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554635648:12345-0@lo:41: 00000004:00000024:1.0:1788869550.495850:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788869550.495895:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8208a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554635648:12345-0@lo:41: Request processed in 79us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869550.495902:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788869550.495940:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8208a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554635648:0@lo:41: 00010000:00010000:2.0:1788869551.000695:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869552.024498:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869552.025941:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869552.025967:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf902a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554635776:0@lo:41: 00000100:00100000:2.0:1788869552.026039:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869552.026168:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554635776 00000100:00100000:0.0:1788869552.026176:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554635776 00000100:00100000:0.0:1788869552.026237:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788869552.026246:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8208aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554635776:12345-0@lo:41: 00000004:00000024:0.0:1788869552.026296:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788869552.026346:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8208aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554635776:12345-0@lo:41: Request processed in 100us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.026352:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788869552.026495:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf902a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554635776:0@lo:41: 00000100:00100000:1.0:1788869552.232889:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869552.232942:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869552.232981:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869552.233100:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545145344 00000100:00100000:2.0:1788869552.233111:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545145344 00000100:00100000:2.0:1788869552.233162:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 197 00000100:00100000:2.0:1788869552.233172:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+8:2387:x1875765545145344:12345-192.168.201.30@tcp:400: 00000100:00100000:2.0:1788869552.233240:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+8:2387:x1875765545145344:12345-192.168.201.30@tcp:400: Request processed in 68us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869552.233248:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 197 00000100:00100000:3.0:1788869552.233572:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545145600 00000100:00100000:3.0:1788869552.233577:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545145600 00000100:00100000:3.0:1788869552.233621:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:3.0:1788869552.233629:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545145600:12345-192.168.201.30@tcp:400: 00000100:00080000:2.0:1788869552.233698:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869552.234720:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545145856 00000100:00100000:0.0:1788869552.234728:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545145856 00000100:00100000:0.0:1788869552.234786:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:0.0:1788869552.234797:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545145856:12345-192.168.201.30@tcp:400: 00000100:00080000:2.0:1788869552.234865:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869552.235172:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545145600:12345-192.168.201.30@tcp:400: Request processed in 1541us (2225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869552.235182:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:1.0:1788869552.238602:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869552.238652:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869552.239525:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545145728 00000100:00100000:2.0:1788869552.239535:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545145728 00000100:00100000:2.0:1788869552.239607:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:2.0:1788869552.239619:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545145728:12345-192.168.201.30@tcp:400: 00000100:00100000:2.0:1788869552.239694:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545145728:12345-192.168.201.30@tcp:400: Request processed in 78us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869552.239713:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:3.0:1788869552.239893:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545145472 00000100:00100000:3.0:1788869552.239898:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545145472 00000100:00100000:3.0:1788869552.239942:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:3.0:1788869552.239951:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+6:2387:x1875765545145472:12345-192.168.201.30@tcp:400: 00000100:00100000:3.0:1788869552.239991:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+6:2387:x1875765545145472:12345-192.168.201.30@tcp:400: Request processed in 41us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869552.239997:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00080000:1.0:1788869552.244886:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869552.244898:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869552.246937:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545145856:12345-192.168.201.30@tcp:400: Request processed in 12130us (13942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.246965:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 10000000:01000000:0.0:1788869552.280568:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788869552.280576:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ffb9bbc800 from 48 10000000:01000000:0.0:1788869552.280581:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788869552.280637:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3e00/0xbead52e175fc2c27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.280649:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3e00/0xbead52e175fc2c27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.280660:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3e00/0xbead52e175fc2c27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869552.280682:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf900000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554635904:0@lo:101: 00000100:00100000:0.0:1788869552.280752:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869552.280826:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8523e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788869552.281814:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554635904 00000100:00100000:1.0:1788869552.281836:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554635904 00000100:00100000:1.0:1788869552.281895:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788869552.281904:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+15:6481:x1875765554635904:12345-0@lo:101: 00010000:00010000:1.0:1788869552.281918:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869552.281936:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb95a9200/0xbead52e175fc2c2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2c27 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.281963:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb95a9200/0xbead52e175fc2c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2c27 expref: 16 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.281975:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb95a9200/0xbead52e175fc2c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2c27 expref: 16 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.281984:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a9200, rc 0) 00000100:00100000:1.0:1788869552.282044:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:6481:x1875765554635904:12345-0@lo:101: Request processed in 140us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869552.282052:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788869552.282189:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf900000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554635904:0@lo:101: 00010000:00010000:0.0:1788869552.282205:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3e00/0xbead52e175fc2c27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c2e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.282214:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3e00/0xbead52e175fc2c27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2c2e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869552.282314:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf900000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554636032:0@lo:501: 00000100:00100000:0.0:1788869552.282341:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869552.282369:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8523e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788869552.282490:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554636032 00000100:00100000:2.0:1788869552.282495:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554636032 00000100:00100000:2.0:1788869552.282519:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788869552.282526:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+16:6481:x1875765554636032:12345-0@lo:501: 00000100:00100000:2.0:1788869552.282643:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+16:6481:x1875765554636032:12345-0@lo:501: Request processed in 117us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869552.282650:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788869552.282793:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf900000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554636032:0@lo:501: 00000100:00100000:0.0:1788869552.282818:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf900000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554636160:0@lo:503: 00000100:00100000:0.0:1788869552.282865:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869552.282888:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8523e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788869552.282940:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554636160 00000100:00100000:2.0:1788869552.282944:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554636160 00000100:00100000:2.0:1788869552.282976:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788869552.282983:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+16:6481:x1875765554636160:12345-0@lo:503: 00000100:00100000:2.0:1788869552.283068:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+16:6481:x1875765554636160:12345-0@lo:503: Request processed in 85us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869552.283075:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788869552.283211:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf900000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554636160:0@lo:503: 00000100:00100000:3.0:1788869552.283695:0:10316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10316:1875765554636288:0@lo:502: 00000100:00100000:3.0:1788869552.283744:0:10316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869552.283776:0:10316:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82320900 going to sleep for 11 seconds 00000100:00100000:2.0:1788869552.283825:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554636288 00000100:00100000:2.0:1788869552.283829:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554636288 00000100:00100000:2.0:1788869552.283863:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788869552.283870:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+16:10316:x1875765554636288:12345-0@lo:502: 00000100:00100000:2.0:1788869552.283961:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+16:10316:x1875765554636288:12345-0@lo:502: Request processed in 91us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869552.283969:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788869552.284082:0:10316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10316:1875765554636288:0@lo:502: 00000100:00100000:0.0:1788869552.284119:0:10316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf900000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10316:1875765554636416:0@lo:502: 00000100:00100000:0.0:1788869552.284155:0:10316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869552.284178:0:10316:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99a60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869552.284422:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554636416 00000100:00100000:1.0:1788869552.284426:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554636416 00000100:00100000:1.0:1788869552.284469:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788869552.284477:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:10316:x1875765554636416:12345-0@lo:502: 00000100:00100000:1.0:1788869552.284561:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:10316:x1875765554636416:12345-0@lo:502: Request processed in 84us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869552.284567:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788869552.284752:0:10316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf900000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10316:1875765554636416:0@lo:502: 00000040:00080000:0.0:1788869552.284784:0:10316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788869552.285140:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788869552.285170:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788869552.285180:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3e00/0xbead52e175fc2c27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c2e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.285203:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3e00/0xbead52e175fc2c27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c2e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869552.285213:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788869552.285215:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788869552.285218:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788869552.285244:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8200/0xbead52e175fc2c35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.285536:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8200/0xbead52e175fc2c35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.285547:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8200/0xbead52e175fc2c35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869552.285564:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554636544:0@lo:101: 00000100:00100000:1.0:1788869552.285599:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869552.286435:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869552.292386:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554636544 00000100:00100000:3.0:1788869552.292413:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554636544 00000100:00100000:3.0:1788869552.292481:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788869552.292493:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+16:6481:x1875765554636544:12345-0@lo:101: 00010000:00010000:3.0:1788869552.292511:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869552.292531:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2c3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2c35 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.292560:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2c35 expref: 17 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.292572:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2c35 expref: 17 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.292581:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9f200, rc 0) 00000100:00100000:3.0:1788869552.292668:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554636544:12345-0@lo:101: Request processed in 177us (7067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869552.292826:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788869552.292934:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554636544:0@lo:101: 00010000:00010000:1.0:1788869552.292952:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8200/0xbead52e175fc2c35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.292962:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8200/0xbead52e175fc2c35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2c3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869552.293031:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554636672:0@lo:501: 00000100:00100000:1.0:1788869552.293064:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869552.293115:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869552.293177:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554636672 00000100:00100000:2.0:1788869552.293181:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554636672 00000100:00100000:2.0:1788869552.293214:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788869552.293222:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554636672:12345-0@lo:501: 00000100:00100000:2.0:1788869552.293617:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554636672:12345-0@lo:501: Request processed in 396us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869552.293624:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788869552.296551:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554636672:0@lo:501: 00000100:00100000:1.0:1788869552.296614:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554636800:0@lo:503: 00000100:00100000:1.0:1788869552.298387:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869552.298446:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869552.298653:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554636800 00000100:00100000:3.0:1788869552.298662:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554636800 00000100:00100000:3.0:1788869552.298741:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788869552.298751:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554636800:12345-0@lo:503: 00000100:00100000:3.0:1788869552.298894:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554636800:12345-0@lo:503: Request processed in 144us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869552.298903:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788869552.299067:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554636800:0@lo:503: 00000100:00100000:1.0:1788869552.305369:0:10317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10317:1875765554636928:0@lo:502: 00000100:00100000:1.0:1788869552.305626:0:10317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869552.305878:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554636928 00000100:00100000:3.0:1788869552.305892:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554636928 00000100:00100000:3.0:1788869552.305951:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788869552.305961:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:10317:x1875765554636928:12345-0@lo:502: 00000100:00100000:3.0:1788869552.306081:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:10317:x1875765554636928:12345-0@lo:502: Request processed in 121us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869552.306088:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788869552.306561:0:10317:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869552.306589:0:10317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10317:1875765554636928:0@lo:502: 00000020:01000000:1.0:1788869552.306620:0:10317:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869552.306631:0:10317:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869552.306633:0:10317:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788869552.306639:0:10317:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788869552.306668:0:10317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10317:1875765554637056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869552.306812:0:10317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869552.306844:0:10317:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869552.306900:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554637056 00000100:00100000:3.0:1788869552.306906:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554637056 00000100:00100000:3.0:1788869552.306975:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788869552.306983:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+17:10317:x1875765554637056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869552.307072:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+17:10317:x1875765554637056:12345-0@lo:502:llog_process_th.0 Request processed in 89us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869552.307079:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788869552.307146:0:10317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10317:1875765554637056:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869552.307164:0:10317:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869552.307169:0:10317:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869552.307170:0:10317:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788869552.307174:0:10317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1788869552.309588:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788869552.309625:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788869552.309637:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8200/0xbead52e175fc2c35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.309683:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8200/0xbead52e175fc2c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869552.309695:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788869552.309698:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ffc10cf800 from 48 10000000:01000000:1.0:1788869552.309701:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788869552.309741:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9600/0xbead52e175fc2c43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.309750:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9600/0xbead52e175fc2c43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.309762:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9600/0xbead52e175fc2c43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869552.309786:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554637184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869552.309854:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869552.311723:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869552.311823:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554637184 00000100:00100000:0.0:1788869552.311831:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554637184 00000100:00100000:0.0:1788869552.311873:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788869552.311881:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+17:6481:x1875765554637184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869552.311895:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869552.311911:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb98e2c00/0xbead52e175fc2c4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2c43 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.311937:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb98e2c00/0xbead52e175fc2c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2c43 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.311947:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb98e2c00/0xbead52e175fc2c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2c43 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.311956:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb98e2c00, rc 0) 00000100:00100000:0.0:1788869552.312009:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554637184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (2155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.312029:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788869552.312109:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554637184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869552.312123:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9600/0xbead52e175fc2c43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.312132:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9600/0xbead52e175fc2c43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2c4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869552.312193:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554637312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869552.312234:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869552.312282:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869552.312329:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554637312 00000100:00100000:0.0:1788869552.312332:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554637312 00000100:00100000:0.0:1788869552.312348:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788869552.312353:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554637312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869552.312464:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554637312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.312471:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788869552.312524:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554637312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869552.312548:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554637440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869552.312596:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869552.312616:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869552.312710:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554637440 00000100:00100000:0.0:1788869552.312714:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554637440 00000100:00100000:0.0:1788869552.312729:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788869552.312734:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554637440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869552.312807:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554637440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.312813:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788869552.312999:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554637440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869552.313293:0:10318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10318:1875765554637568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869552.313326:0:10318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869552.313340:0:10318:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f2900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869552.313387:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554637568 00000100:00100000:0.0:1788869552.313390:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554637568 00000100:00100000:0.0:1788869552.313406:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788869552.313411:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:10318:x1875765554637568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869552.313494:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:10318:x1875765554637568:12345-0@lo:502:llog_process_th.0 Request processed in 82us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.313500:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788869552.313669:0:10318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10318:1875765554637568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869552.313704:0:10318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10318:1875765554637696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869552.313732:0:10318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869552.313756:0:10318:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2480 going to sleep for 11 seconds 00000100:00100000:0.0:1788869552.313790:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554637696 00000100:00100000:0.0:1788869552.313794:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554637696 00000100:00100000:0.0:1788869552.313808:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788869552.313813:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:10318:x1875765554637696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869552.313875:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:10318:x1875765554637696:12345-0@lo:502:llog_process_th.0 Request processed in 61us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.313881:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788869552.313989:0:10318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10318:1875765554637696:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788869552.314005:0:10318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788869552.314419:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788869552.314438:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788869552.314455:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9600/0xbead52e175fc2c43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.314469:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9600/0xbead52e175fc2c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869552.314479:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788869552.314482:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788869552.314486:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788869552.314510:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3800/0xbead52e175fc2c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.314518:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3800/0xbead52e175fc2c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.314526:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3800/0xbead52e175fc2c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869552.314541:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf900000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554637824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869552.314570:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869552.314722:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe810db240 going to sleep for 11 seconds 00000100:00100000:3.0:1788869552.314789:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554637824 00000100:00100000:3.0:1788869552.314795:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554637824 00000100:00100000:3.0:1788869552.314859:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788869552.314866:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+18:6481:x1875765554637824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869552.314875:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869552.314889:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb9a9e400/0xbead52e175fc2c58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2c51 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.314908:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb9a9e400/0xbead52e175fc2c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2c51 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.314918:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb9a9e400/0xbead52e175fc2c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2c51 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.314926:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9e400, rc 0) 00000100:00100000:3.0:1788869552.314977:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+19:6481:x1875765554637824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869552.314983:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788869552.315049:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf900000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554637824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869552.315063:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3800/0xbead52e175fc2c51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.315072:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3800/0xbead52e175fc2c51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2c58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869552.315118:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554637952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869552.315141:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869552.315167:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2480 going to sleep for 11 seconds 00000100:00100000:3.0:1788869552.315378:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554637952 00000100:00100000:3.0:1788869552.315382:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554637952 00000100:00100000:3.0:1788869552.315400:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788869552.315407:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+19:6481:x1875765554637952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869552.315527:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+19:6481:x1875765554637952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869552.315533:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788869552.315605:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554637952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869552.315630:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554638080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869552.315664:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869552.315689:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2480 going to sleep for 11 seconds 00000100:00100000:3.0:1788869552.315803:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554638080 00000100:00100000:3.0:1788869552.315808:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554638080 00000100:00100000:3.0:1788869552.315824:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788869552.315829:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+19:6481:x1875765554638080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869552.315908:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+19:6481:x1875765554638080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869552.315915:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788869552.315978:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554638080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869552.316411:0:10319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10319:1875765554638208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869552.316455:0:10319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869552.316514:0:10319:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869552.316528:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554638208 00000100:00100000:2.0:1788869552.316533:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554638208 00000100:00100000:2.0:1788869552.316557:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788869552.316563:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+19:10319:x1875765554638208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869552.316652:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+19:10319:x1875765554638208:12345-0@lo:502:llog_process_th.0 Request processed in 88us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869552.316659:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788869552.316692:0:10319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10319:1875765554638208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869552.316714:0:10319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869552.316722:0:10319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869552.316725:0:10319:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788869552.316729:0:10319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788869552.316746:0:10319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10319:1875765554638336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869552.316773:0:10319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869552.316792:0:10319:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869552.316826:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554638336 00000100:00100000:0.0:1788869552.316830:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554638336 00000100:00100000:0.0:1788869552.316860:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788869552.316871:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+19:10319:x1875765554638336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869552.316935:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+19:10319:x1875765554638336:12345-0@lo:502:llog_process_th.0 Request processed in 63us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.316941:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788869552.317028:0:10319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10319:1875765554638336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869552.317043:0:10319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869552.317046:0:10319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869552.317048:0:10319:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788869552.317051:0:10319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1788869552.317180:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788869552.317198:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788869552.317208:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3800/0xbead52e175fc2c51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.317229:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3800/0xbead52e175fc2c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869552.317239:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788869552.317242:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ff89980800 from 48 10000000:01000000:0.0:1788869552.317245:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788869552.317295:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2000/0xbead52e175fc2c5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.317303:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2000/0xbead52e175fc2c5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.317312:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2000/0xbead52e175fc2c5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869552.317324:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf900700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554638464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869552.317347:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869552.317366:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe810db240 going to sleep for 11 seconds 00000100:00100000:1.0:1788869552.317409:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554638464 00000100:00100000:1.0:1788869552.317412:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554638464 00000100:00100000:1.0:1788869552.317430:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788869552.317435:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+19:6481:x1875765554638464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869552.317458:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869552.317470:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb95a8e00/0xbead52e175fc2c66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2c5f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.317488:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb95a8e00/0xbead52e175fc2c66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2c5f expref: 20 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.317497:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb95a8e00/0xbead52e175fc2c66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2c5f expref: 20 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.317506:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a8e00, rc 0) 00000100:00100000:1.0:1788869552.317535:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+20:6481:x1875765554638464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869552.317541:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788869552.317718:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf900700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554638464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869552.317739:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2000/0xbead52e175fc2c5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.317747:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2000/0xbead52e175fc2c5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2c66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869552.317790:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf900700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554638592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869552.317814:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869552.317866:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe810db240 going to sleep for 11 seconds 00000100:00100000:1.0:1788869552.317999:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554638592 00000100:00100000:1.0:1788869552.318003:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554638592 00000100:00100000:1.0:1788869552.318028:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788869552.318034:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+20:6481:x1875765554638592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869552.318124:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+20:6481:x1875765554638592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869552.318131:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788869552.318209:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf900700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554638592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869552.318243:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf900700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554638720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869552.318310:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869552.318329:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe810db240 going to sleep for 11 seconds 00000100:00100000:1.0:1788869552.318434:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554638720 00000100:00100000:1.0:1788869552.318438:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554638720 00000100:00100000:1.0:1788869552.318574:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788869552.318592:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+20:6481:x1875765554638720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869552.318659:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+20:6481:x1875765554638720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869552.318674:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788869552.319565:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf900700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554638720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869552.319881:0:10320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf900700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10320:1875765554638848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869552.319931:0:10320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869552.319962:0:10320:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe810db240 going to sleep for 11 seconds 00000100:00100000:1.0:1788869552.320002:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554638848 00000100:00100000:1.0:1788869552.320008:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554638848 00000100:00100000:1.0:1788869552.320041:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788869552.320048:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+20:10320:x1875765554638848:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869552.320139:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+20:10320:x1875765554638848:12345-0@lo:502:llog_process_th.0 Request processed in 91us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869552.320146:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788869552.320350:0:10320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf900700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10320:1875765554638848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869552.320386:0:10320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf900700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10320:1875765554638976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869552.320415:0:10320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869552.320435:0:10320:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe832af600 going to sleep for 11 seconds 00000100:00100000:1.0:1788869552.320512:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554638976 00000100:00100000:1.0:1788869552.320517:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554638976 00000100:00100000:1.0:1788869552.320543:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788869552.320549:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+20:10320:x1875765554638976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869552.320607:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+20:10320:x1875765554638976:12345-0@lo:502:llog_process_th.0 Request processed in 57us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869552.320613:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788869552.320679:0:10320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf900700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10320:1875765554638976:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788869552.320698:0:10320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788869552.320902:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788869552.320922:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788869552.320931:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2000/0xbead52e175fc2c5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.320943:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2000/0xbead52e175fc2c5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869552.320952:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788869552.320954:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1788869552.320957:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788869552.320978:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9e00/0xbead52e175fc2c6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.320990:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9e00/0xbead52e175fc2c6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.321000:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9e00/0xbead52e175fc2c6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869552.321012:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554639104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869552.321036:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869552.321056:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869552.321090:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554639104 00000100:00100000:0.0:1788869552.321098:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554639104 00000100:00100000:0.0:1788869552.321124:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788869552.321129:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+20:6481:x1875765554639104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869552.321137:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869552.321148:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb98e3600/0xbead52e175fc2c74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2c6d expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.321166:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb98e3600/0xbead52e175fc2c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2c6d expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.321176:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb98e3600/0xbead52e175fc2c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2c6d expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.321185:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb98e3600, rc 0) 00000100:00100000:0.0:1788869552.321221:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554639104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.321227:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788869552.322529:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554639104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869552.322553:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9e00/0xbead52e175fc2c6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c74 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.322565:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9e00/0xbead52e175fc2c6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2c74 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869552.322649:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554639232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869552.322697:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869552.322725:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869552.322886:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554639232 00000100:00100000:0.0:1788869552.322891:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554639232 00000100:00100000:0.0:1788869552.322923:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788869552.322929:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554639232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869552.323038:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554639232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.323043:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788869552.323228:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554639232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869552.323281:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554639360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869552.323327:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869552.323349:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869552.323580:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554639360 00000100:00100000:0.0:1788869552.323583:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554639360 00000100:00100000:0.0:1788869552.323605:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788869552.323610:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554639360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869552.323685:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554639360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.323692:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788869552.323794:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554639360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869552.324124:0:10321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10321:1875765554639488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869552.324153:0:10321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869552.324169:0:10321:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869552.324515:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554639488 00000100:00100000:0.0:1788869552.324521:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554639488 00000100:00100000:0.0:1788869552.324770:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788869552.324778:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:10321:x1875765554639488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869552.324869:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:10321:x1875765554639488:12345-0@lo:502:llog_process_th.0 Request processed in 93us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.324874:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788869552.324923:0:10321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10321:1875765554639488:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869552.324941:0:10321:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869552.324949:0:10321:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869552.324951:0:10321:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788869552.324956:0:10321:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788869552.324977:0:10321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10321:1875765554639616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869552.325010:0:10321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869552.325176:0:10321:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869552.325373:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554639616 00000100:00100000:2.0:1788869552.325378:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554639616 00000100:00100000:2.0:1788869552.325403:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788869552.325409:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88938450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+21:10321:x1875765554639616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869552.325488:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88938450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+21:10321:x1875765554639616:12345-0@lo:502:llog_process_th.0 Request processed in 80us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869552.325493:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788869552.325560:0:10321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10321:1875765554639616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869552.325573:0:10321:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869552.325576:0:10321:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869552.325578:0:10321:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788869552.325581:0:10321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1788869552.325725:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1788869552.325741:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788869552.325748:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9e00/0xbead52e175fc2c6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c74 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.325755:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9e00/0xbead52e175fc2c6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c74 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869552.325762:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788869552.325764:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ff8b15e800 from 48 10000000:01000000:2.0:1788869552.325770:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788869552.325789:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2c7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.325795:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2c7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.325801:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2c7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869552.325810:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82089c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554639744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869552.325829:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869552.325851:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae5fe600 going to sleep for 11 seconds 00000100:00100000:1.0:1788869552.325885:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554639744 00000100:00100000:1.0:1788869552.325888:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554639744 00000100:00100000:1.0:1788869552.325901:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788869552.325904:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88938c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554639744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869552.325909:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869552.325919:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb95a8000/0xbead52e175fc2c82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2c7b expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.325934:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb95a8000/0xbead52e175fc2c82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2c7b expref: 22 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.325940:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb95a8000/0xbead52e175fc2c82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2c7b expref: 22 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869552.325958:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a8000, rc 0) 00000100:00100000:1.0:1788869552.325996:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88938c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554639744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869552.326003:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788869552.326056:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82089c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554639744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869552.326065:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2c7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c82 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.326072:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2c7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2c82 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869552.326103:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82089c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554639872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869552.326119:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869552.326133:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae5fe600 going to sleep for 11 seconds 00000100:00100000:1.0:1788869552.326164:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554639872 00000100:00100000:1.0:1788869552.326167:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554639872 00000100:00100000:1.0:1788869552.326179:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788869552.326182:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554639872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869552.326341:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554639872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869552.326347:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788869552.326436:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82089c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554639872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869552.326469:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82089c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554640000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869552.326496:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869552.326510:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae5fe600 going to sleep for 11 seconds 00000100:00100000:0.0:1788869552.326637:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554640000 00000100:00100000:0.0:1788869552.326641:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554640000 00000100:00100000:0.0:1788869552.326657:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788869552.326661:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554640000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869552.326737:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554640000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.326743:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788869552.326818:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82089c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554640000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869552.327422:0:10322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82089c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10322:1875765554640128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869552.327472:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869552.327528:0:10322:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff87e81540 going to sleep for 11 seconds 00000100:00100000:0.0:1788869552.327563:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554640128 00000100:00100000:0.0:1788869552.327567:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554640128 00000100:00100000:0.0:1788869552.327629:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788869552.327637:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+22:10322:x1875765554640128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869552.327725:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+22:10322:x1875765554640128:12345-0@lo:502:llog_process_th.0 Request processed in 89us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.327731:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788869552.327801:0:10322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82089c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10322:1875765554640128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869552.327836:0:10322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82089c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10322:1875765554640256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869552.327867:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869552.327943:0:10322:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff87e81540 going to sleep for 11 seconds 00000100:00100000:3.0:1788869552.328000:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554640256 00000100:00100000:3.0:1788869552.328005:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554640256 00000100:00100000:3.0:1788869552.328026:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788869552.328032:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88938850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+22:10322:x1875765554640256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869552.328105:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88938850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+22:10322:x1875765554640256:12345-0@lo:502:llog_process_th.0 Request processed in 72us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869552.328111:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788869552.328188:0:10322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82089c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10322:1875765554640256:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788869552.328206:0:10322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788869552.328460:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788869552.328480:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788869552.328489:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2c7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c82 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.328507:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c82 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869552.328515:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788869552.328518:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1788869552.328520:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788869552.328544:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f000/0xbead52e175fc2c89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.328551:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f000/0xbead52e175fc2c89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.328560:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f000/0xbead52e175fc2c89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869552.328572:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554640384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788869552.328602:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869552.328630:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82320780 going to sleep for 11 seconds 00000100:00100000:2.0:1788869552.328711:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554640384 00000100:00100000:2.0:1788869552.328716:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554640384 00000100:00100000:2.0:1788869552.328735:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788869552.328741:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88939050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554640384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869552.328749:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869552.328761:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff81534800/0xbead52e175fc2c90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2c89 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.328782:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff81534800/0xbead52e175fc2c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2c89 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.328792:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff81534800/0xbead52e175fc2c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2c89 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.328799:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534800, rc 0) 00000100:00100000:2.0:1788869552.328834:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88939050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554640384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869552.328847:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788869552.328909:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554640384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869552.328921:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f000/0xbead52e175fc2c89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c90 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.328930:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f000/0xbead52e175fc2c89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2c90 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869552.328977:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554640512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869552.329000:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869552.329027:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82320780 going to sleep for 11 seconds 00000100:00100000:2.0:1788869552.329068:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554640512 00000100:00100000:2.0:1788869552.329072:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554640512 00000100:00100000:2.0:1788869552.329089:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788869552.329094:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88939c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554640512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869552.329406:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88939c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554640512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 310us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869552.329413:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788869552.329591:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554640512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869552.329619:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554640640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869552.329660:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869552.329685:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82320780 going to sleep for 11 seconds 00000100:00100000:2.0:1788869552.329726:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554640640 00000100:00100000:2.0:1788869552.329731:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554640640 00000100:00100000:2.0:1788869552.329747:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788869552.329752:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88939850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554640640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869552.329824:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88939850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554640640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869552.329831:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788869552.329930:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554640640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869552.330410:0:10323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10323:1875765554640768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869552.330445:0:10323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869552.330540:0:10323:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82320f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869552.330570:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554640768 00000100:00100000:0.0:1788869552.330573:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554640768 00000100:00100000:0.0:1788869552.330637:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788869552.330644:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88939450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+23:10323:x1875765554640768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869552.330752:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88939450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+23:10323:x1875765554640768:12345-0@lo:502:llog_process_th.0 Request processed in 109us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.330757:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788869552.330850:0:10323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10323:1875765554640768:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788869552.330867:0:10323:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869552.330873:0:10323:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869552.330875:0:10323:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788869552.330879:0:10323:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788869552.330892:0:10323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10323:1875765554640896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869552.330916:0:10323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869552.330962:0:10323:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82320f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869552.330995:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554640896 00000100:00100000:0.0:1788869552.331000:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554640896 00000100:00100000:0.0:1788869552.331045:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788869552.331049:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88938050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+23:10323:x1875765554640896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869552.331101:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88938050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+23:10323:x1875765554640896:12345-0@lo:502:llog_process_th.0 Request processed in 51us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.331105:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788869552.331199:0:10323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10323:1875765554640896:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788869552.331221:0:10323:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869552.331225:0:10323:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869552.331225:0:10323:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788869552.331228:0:10323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788869552.331928:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1788869552.331949:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788869552.331958:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f000/0xbead52e175fc2c89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c90 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.331969:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f000/0xbead52e175fc2c89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c90 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869552.331977:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788869552.331980:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99ff8b770000 from 1 10000000:01000000:0.0:1788869552.331983:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788869552.332007:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2800/0xbead52e175fc2c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.332015:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2800/0xbead52e175fc2c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869552.332032:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2800/0xbead52e175fc2c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869552.332046:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf900700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554641024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869552.332082:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869552.332142:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe832af180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869552.332191:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554641024 00000100:00100000:2.0:1788869552.332196:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554641024 00000100:00100000:2.0:1788869552.332417:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788869552.332426:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554641024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869552.332435:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869552.332478:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff81534e00/0xbead52e175fc2c9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2c97 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.332501:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff81534e00/0xbead52e175fc2c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2c97 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.332510:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff81534e00/0xbead52e175fc2c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2c97 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869552.332525:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534e00, rc 0) 00000100:00100000:2.0:1788869552.332601:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554641024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869552.332606:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788869552.332830:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf900700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554641024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869552.332845:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2800/0xbead52e175fc2c97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c9e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.332865:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2800/0xbead52e175fc2c97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2c9e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869552.332923:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554641152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869552.332951:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869552.332977:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82320f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869552.333016:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554641152 00000100:00100000:2.0:1788869552.333021:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554641152 00000100:00100000:2.0:1788869552.333051:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788869552.333058:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554641152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869552.333125:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554641152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 68us (173us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788869552.333132:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788869552.333226:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554641152:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788869552.333279:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788869552.333286:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2800/0xbead52e175fc2c97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c9e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869552.333294:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2800/0xbead52e175fc2c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c9e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869552.536536:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554641664:0@lo:400:kworker.0 00000100:00100000:3.0:1788869552.536538:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf903480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554641280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869552.536617:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554641408:0@lo:400:kworker.0 00000100:00100000:3.0:1788869552.539076:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869552.539146:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554641920:0@lo:400:kworker.0 00000100:00100000:3.0:1788869552.539174:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869552.539199:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875765554642432:0@lo:400:kworker.0 00000100:00100000:3.0:1788869552.539215:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869552.539269:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554641536:0@lo:400:kworker.0 00000100:00100000:3.0:1788869552.539293:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869552.539310:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554642048:0@lo:400:kworker.0 00000100:00100000:3.0:1788869552.539328:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869552.539355:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554642560:0@lo:400:kworker.0 00000100:00100000:3.0:1788869552.539372:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869552.539397:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554641920 00000100:00100000:3.0:1788869552.539403:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554641920 00000100:00100000:3.0:1788869552.539456:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554642432 00000100:00100000:3.0:1788869552.539459:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554642432 00000100:00100000:3.0:1788869552.539470:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554642048 00000100:00100000:3.0:1788869552.539472:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554642048 00000100:00100000:3.0:1788869552.539481:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554642560 00000100:00100000:3.0:1788869552.539483:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554642560 00000100:00100000:3.0:1788869552.539495:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788869552.541051:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554641280 00000100:00100000:0.0:1788869552.541062:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554641280 00000100:00100000:0.0:1788869552.541114:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788869552.541123:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554641280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869552.541154:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869552.541220:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554641280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (2149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.541227:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788869552.541295:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf903480 x1875765554641280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869568 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869552.541315:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf903480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554641280:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788869552.541351:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869552.541355:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869552.541358:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869552.541376:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554641536 00000100:00100000:0.0:1788869552.541380:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554641536 00000100:00100000:0.0:1788869552.541402:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788869552.541408:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554641536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869552.541458:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554641536:12345-0@lo:400:kworker.0 Request processed in 50us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.541483:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788869552.541519:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788869552.541527:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875765554642432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869552.541568:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875765554642432:12345-0@lo:400:kworker.0 Request processed in 42us (2351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.541574:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788869552.541589:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788869552.541595:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554642048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869552.541623:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554642048:12345-0@lo:400:kworker.0 Request processed in 29us (2294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.541629:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788869552.541639:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788869552.541646:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554642560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869552.541672:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554642560:12345-0@lo:400:kworker.0 Request processed in 27us (2298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.541676:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788869552.541705:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875765554642432:0@lo:400:kworker.0 00000100:00100000:0.0:1788869552.541743:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554641536:0@lo:400:kworker.0 00010000:00080000:0.0:1788869552.541755:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf958700 x1875765554642048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869552.541764:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554642048:0@lo:400:kworker.0 00010000:00080000:0.0:1788869552.541773:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf959c00 x1875765554642560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869552.541795:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554642560:0@lo:400:kworker.0 00000100:00100000:3.0:1788869552.542607:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554641920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869552.542665:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554641920:12345-0@lo:400:kworker.0 Request processed in 3163us (3490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869552.542672:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788869552.542825:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554641920:0@lo:400:kworker.0 00000100:00100000:1.0:1788869552.551862:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869552.551985:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554642176:0@lo:400:kworker.0 00000100:00100000:1.0:1788869552.552033:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869552.552075:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554642688:0@lo:400:kworker.0 00000100:00100000:1.0:1788869552.552099:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869552.552153:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554642176 00000100:00100000:1.0:1788869552.552162:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554642176 00000100:00100000:1.0:1788869552.552228:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554642688 00000100:00100000:1.0:1788869552.552232:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554642688 00000100:00100000:1.0:1788869552.552294:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788869552.552304:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554642176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869552.552359:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554642176:12345-0@lo:400:kworker.0 Request processed in 57us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869552.552382:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788869552.552398:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788869552.552404:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf958700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554642688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869552.552433:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf958700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554642688:12345-0@lo:400:kworker.0 Request processed in 29us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869552.552684:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788869552.552706:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869552.552710:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869552.552735:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf95a300 x1875765554642176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869552.552748:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554642176:0@lo:400:kworker.0 00010000:00080000:1.0:1788869552.552758:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf959500 x1875765554642688/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869552.552764:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554642688:0@lo:400:kworker.0 00000100:00100000:0.0:1788869552.555178:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554641664 00000100:00100000:0.0:1788869552.555193:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554641664 00000100:00100000:0.0:1788869552.555737:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788869552.555749:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf95b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554641664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869552.555867:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf95b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554641664:12345-0@lo:400:kworker.0 Request processed in 120us (4012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.555875:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788869552.555955:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554641664:0@lo:400:kworker.0 00000100:00100000:3.0:1788869552.556678:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869552.556709:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554641792:0@lo:400:kworker.0 00000100:00100000:3.0:1788869552.556740:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869552.556768:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554642304:0@lo:400:kworker.0 00000100:00100000:3.0:1788869552.556791:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869552.556817:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554642816:0@lo:400:kworker.0 00000100:00100000:1.0:1788869552.556944:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554642304 00000100:00100000:1.0:1788869552.556950:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554642304 00000100:00100000:1.0:1788869552.556999:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788869552.557007:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554642304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869552.557048:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554642304:12345-0@lo:400:kworker.0 Request processed in 41us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869552.557054:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788869552.557075:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869552.557117:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788869552.557172:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf958380 x1875765554642304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869552.557185:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554642304:0@lo:400:kworker.0 00000100:00100000:1.0:1788869552.557274:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554642816 00000100:00100000:1.0:1788869552.557291:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554642816 00000100:00100000:1.0:1788869552.557320:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788869552.557326:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554642816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869552.557359:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554642816:12345-0@lo:400:kworker.0 Request processed in 33us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869552.557365:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788869552.557607:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf95aa00 x1875765554642816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869552.557629:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554642816:0@lo:400:kworker.0 00000100:00100000:0.0:1788869552.559773:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554641408 00000100:00100000:0.0:1788869552.559787:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554641408 00000100:00100000:2.0:1788869552.560039:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554641792 00000100:00100000:2.0:1788869552.560045:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554641792 00000100:00100000:2.0:1788869552.560100:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788869552.560111:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554641792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869552.560218:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554641792:12345-0@lo:400:kworker.0 Request processed in 109us (3476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869552.560227:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788869552.560305:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554641792:0@lo:400:kworker.0 00000100:00100000:0.0:1788869552.560407:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788869552.560417:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554641408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869552.560487:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554641408:12345-0@lo:400:kworker.0 Request processed in 72us (3809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869552.560493:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788869552.561297:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554641408:0@lo:400:kworker.0 00000100:00100000:0.0:1788869553.048785:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf903480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554642944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869553.048859:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869553.048903:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554642944 00000100:00100000:1.0:1788869553.048912:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554642944 00000100:00100000:1.0:1788869553.048959:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788869553.048969:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf903100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554642944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788869553.048993:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869553.049049:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf903100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554642944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869553.049057:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788869553.050795:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf903480 x1875765554642944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869569 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869553.050821:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf903480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554642944:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788869553.051877:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869553.517846:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869553.521618:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545145984 00000100:00100000:1.0:1788869553.521636:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545145984 00000100:00100000:1.0:1788869553.521711:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 240 00000100:00100000:1.0:1788869553.521732:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+8:6155:x1875765545145984:12345-192.168.201.30@tcp:101: 00010000:00010000:1.0:1788869553.521749:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869553.521768:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb95a9800/0xbead52e175fc2ca5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa90b expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869553.521798:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb95a9800/0xbead52e175fc2ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa90b expref: 9 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869553.521810:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb95a9800/0xbead52e175fc2ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa90b expref: 9 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869553.521839:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a9800, rc 0) 00000100:00100000:1.0:1788869553.521915:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+9:6155:x1875765545145984:12345-192.168.201.30@tcp:101: Request processed in 194us (4083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869553.521923:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 240 00000100:00100000:1.0:1788869553.526144:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869553.526224:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545146112 00000100:00100000:0.0:1788869553.526233:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545146112 00000100:00100000:0.0:1788869553.526333:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 241 00000100:00100000:0.0:1788869553.526356:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+9:6155:x1875765545146112:12345-192.168.201.30@tcp:501: 00000100:00100000:0.0:1788869553.526636:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+9:6155:x1875765545146112:12345-192.168.201.30@tcp:501: Request processed in 282us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869553.526645:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 241 00000100:00100000:3.0:1788869553.528804:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869553.528969:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545146240 00000100:00100000:1.0:1788869553.528980:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545146240 00000100:00100000:1.0:1788869553.529056:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 242 00000100:00100000:1.0:1788869553.529067:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+9:6155:x1875765545146240:12345-192.168.201.30@tcp:503: 00000100:00100000:1.0:1788869553.529245:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+9:6155:x1875765545146240:12345-192.168.201.30@tcp:503: Request processed in 179us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869553.529279:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 242 00000100:00100000:2.0:1788869553.537913:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869553.539606:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545146368 00000100:00100000:0.0:1788869553.539622:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545146368 00000100:00100000:0.0:1788869553.539694:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 243 00000100:00100000:0.0:1788869553.539705:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff85f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+9:6642:x1875765545146368:12345-192.168.201.30@tcp:502: 00000100:00100000:0.0:1788869553.539889:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff85f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+9:6642:x1875765545146368:12345-192.168.201.30@tcp:502: Request processed in 185us (1993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869553.539898:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 243 00000100:00100000:3.0:1788869553.550837:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869553.550974:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545146496 00000100:00100000:2.0:1788869553.550988:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545146496 00000100:00100000:2.0:1788869553.551077:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 244 00000100:00100000:2.0:1788869553.551090:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+9:6642:x1875765545146496:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869553.551361:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+9:6642:x1875765545146496:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 272us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869553.551370:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 244 00000100:00100000:3.0:1788869553.555469:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869553.556286:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545146624 00000100:00100000:0.0:1788869553.556303:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545146624 00000100:00100000:0.0:1788869553.556385:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 245 00000100:00100000:0.0:1788869553.556397:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+9:6155:x1875765545146624:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869553.556414:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869553.556442:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb98e3c00/0xbead52e175fc2cac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa912 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869553.556470:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb98e3c00/0xbead52e175fc2cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa912 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869553.556482:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb98e3c00/0xbead52e175fc2cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa912 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869553.556491:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb98e3c00, rc 0) 00000100:00100000:0.0:1788869553.556712:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:6155:x1875765545146624:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 316us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869553.556733:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 245 00000100:00100000:3.0:1788869553.559164:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869553.559663:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545146752 00000100:00100000:1.0:1788869553.559677:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545146752 00000100:00100000:1.0:1788869553.559782:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 246 00000100:00100000:1.0:1788869553.559796:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:6155:x1875765545146752:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869553.559950:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:6155:x1875765545146752:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 157us (799us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788869553.559960:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 246 00010000:00010000:2.0:1788869554.072558:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788869554.492728:0:10360:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1da25e80 20000000:00000080:3.0:1788869554.492745:0:10360:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99ffbf9a0000 uarg=0000000000000000 20000000:01000000:3.0:1788869554.492892:0:10360:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788869554.492899:0:10360:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788869554.492903:0:10360:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788869554.493542:0:10361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788869554.493800:0:10360:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788869554.502806:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788869554.502848:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788869554.502866:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788869554.502881:0:10360:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788869554.502900:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffb95a8c00/0xbead52e175fc2cb3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.502931:0:10360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ff80030000/0xbead52e175fc294f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2948 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.502940:0:10360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ff80031200/0xbead52e175fc295d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2956 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.502946:0:10360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ff80030c00/0xbead52e175fc29b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc29aa expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.502953:0:10360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb95a8400/0xbead52e175fc2ad7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2ad0 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.502963:0:10360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb95a8a00/0xbead52e175fc2bef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa8d3 expref: 9 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.502971:0:10360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffb95a8c00/0xbead52e175fc2cb3 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.503011:0:10360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb95a8a00/0xbead52e175fc2bef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa8d3 expref: 9 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.503560:0:10360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffb95a8a00/0xbead52e175fc2bef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa8d3 expref: 9 pid: 6478 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869554.503581:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10360:1875765554643072:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788869554.503749:0:10360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb95a8400/0xbead52e175fc2ad7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2ad0 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.503758:0:10360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffb95a8400/0xbead52e175fc2ad7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2ad0 expref: 23 pid: 6479 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869554.503776:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf959500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10360:1875765554643200:0@lo:104: 00000100:00100000:1.0:1788869554.503818:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788869554.503861:0:10360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ff80030c00/0xbead52e175fc29b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc29aa expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.503871:0:10360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ff80030c00/0xbead52e175fc29b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc29aa expref: 23 pid: 6479 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869554.503880:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10360:1875765554643328:0@lo:104: 00000100:00100000:1.0:1788869554.503911:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788869554.503948:0:10360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ff80031200/0xbead52e175fc295d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2956 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.503956:0:10360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ff80031200/0xbead52e175fc295d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2956 expref: 23 pid: 6478 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869554.503964:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10360:1875765554643456:0@lo:104: 00010000:00010000:1.0:1788869554.503987:0:10360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ff80030000/0xbead52e175fc294f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2948 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.503995:0:10360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ff80030000/0xbead52e175fc294f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2948 expref: 23 pid: 6476 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869554.504002:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10360:1875765554643584:0@lo:104: 00000100:00100000:1.0:1788869554.504032:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84fad180 going to sleep for 11 seconds 00000100:00100000:0.0:1788869554.504088:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788869554.504108:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869554.504124:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869554.504133:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554643200 00000100:00100000:0.0:1788869554.504140:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554643200 00000100:00100000:0.0:1788869554.504178:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554643328 00000100:00100000:0.0:1788869554.504181:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554643328 00000100:00100000:0.0:1788869554.504189:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554643456 00000100:00100000:0.0:1788869554.504190:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554643456 00000100:00100000:0.0:1788869554.504197:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554643584 00000100:00100000:0.0:1788869554.504199:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554643584 00000100:00100000:0.0:1788869554.504207:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788869554.504213:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf95a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+6:10360:x1875765554643200:12345-0@lo:104: 00010000:00010000:0.0:1788869554.504224:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ad0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2ad7 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.504281:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788869554.504285:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf95a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+6:10360:x1875765554643200:12345-0@lo:104: Request processed in 73us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869554.504290:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788869554.504302:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788869554.504306:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe833bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+5:10360:x1875765554643328:12345-0@lo:104: 00010000:00010000:0.0:1788869554.504310:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc29aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc29b1 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.504329:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788869554.504331:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe833bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+5:10360:x1875765554643328:12345-0@lo:104: Request processed in 26us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869554.504341:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788869554.504369:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788869554.504375:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf903480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+4:10360:x1875765554643456:12345-0@lo:104: 00010000:00010000:0.0:1788869554.504382:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ff80031a00/0xbead52e175fc2956 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc295d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.504423:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788869554.504427:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf903480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+4:10360:x1875765554643456:12345-0@lo:104: Request processed in 54us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869554.504432:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788869554.504440:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788869554.504444:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf901c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+3:10360:x1875765554643584:12345-0@lo:104: 00010000:00010000:0.0:1788869554.504449:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ff81535400/0xbead52e175fc2948 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc294f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.504464:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788869554.504467:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf901c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+3:10360:x1875765554643584:12345-0@lo:104: Request processed in 23us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869554.504470:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788869554.504907:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf959500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10360:1875765554643200:0@lo:104: 00000100:00100000:1.0:1788869554.504918:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10360:1875765554643328:0@lo:104: 00000100:00100000:1.0:1788869554.504934:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10360:1875765554643456:0@lo:104: 00000100:00100000:1.0:1788869554.504941:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10360:1875765554643584:0@lo:104: 00010000:00010000:2.0:1788869554.505004:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788869554.505012:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ad0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2ad7 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.505020:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a9400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1788869554.505024:0:7425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ad0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2ad7 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.505033:0:7425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2ad7 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869554.505042:0:7425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2ad7 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869554.505047:0:7425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788869554.505087:0:7425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ad0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2ad7 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.505093:0:7425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869554.505122:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ad0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2ad7 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.505139:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ad0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2ad7 expref: -99 pid: 9475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.505150:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788869554.505153:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc29aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc29b1 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.505159:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031000 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1788869554.505162:0:7425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc29aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc29b1 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.505168:0:7425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc29aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc29b1 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869554.505174:0:7425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc29aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc29b1 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869554.505179:0:7425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788869554.505192:0:7425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc29aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc29b1 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.505198:0:7425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869554.505204:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc29aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc29b1 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.505210:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc29aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc29b1 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.505219:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869554.505227:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ff80031a00/0xbead52e175fc2956 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc295d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.505233:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031a00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1788869554.505236:0:7425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ff80031a00/0xbead52e175fc2956 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc295d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.505243:0:7425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ff80031a00/0xbead52e175fc2956 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc295d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869554.505249:0:7425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ff80031a00/0xbead52e175fc2956 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc295d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869554.505281:0:7425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788869554.505295:0:7425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ff80031a00/0xbead52e175fc2956 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc295d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.505301:0:7425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869554.505318:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ff80031a00/0xbead52e175fc2956 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc295d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.505325:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ff80031a00/0xbead52e175fc2956 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc295d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.505334:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869554.505337:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ff81535400/0xbead52e175fc2948 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc294f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.505343:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1788869554.505346:0:7425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ff81535400/0xbead52e175fc2948 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc294f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.505363:0:7425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ff81535400/0xbead52e175fc2948 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc294f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869554.505369:0:7425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ff81535400/0xbead52e175fc2948 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc294f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869554.505374:0:7425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788869554.505387:0:7425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ff81535400/0xbead52e175fc2948 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc294f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.505393:0:7425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869554.505399:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ff81535400/0xbead52e175fc2948 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc294f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.505441:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ff81535400/0xbead52e175fc2948 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc294f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.505456:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869554.505457:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869554.505459:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869554.505465:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869554.505470:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869554.505676:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554643840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869554.505719:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869554.505755:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869554.505760:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554643712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869554.505781:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869554.505804:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554643968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869554.505834:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869554.505850:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869554.505855:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8208a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554644096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869554.505875:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869554.505903:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554643840 00000100:00100000:2.0:1788869554.505908:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554643840 00010000:00010000:2.0:1788869554.505930:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ff80030c00/0xbead52e175fc29b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc29aa expref: 24 pid: 6479 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869554.505952:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554643712 00000100:00100000:2.0:1788869554.505955:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554643712 00010000:00010000:2.0:1788869554.505968:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb95a8400/0xbead52e175fc2ad7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2ad0 expref: 25 pid: 6479 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869554.505978:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554643968 00000100:00100000:2.0:1788869554.505980:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554643968 00010000:00010000:2.0:1788869554.505988:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ff80031200/0xbead52e175fc295d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2956 expref: 26 pid: 6478 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869554.505997:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554644096 00000100:00100000:2.0:1788869554.505999:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554644096 00010000:00010000:2.0:1788869554.506007:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ff80030000/0xbead52e175fc294f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2948 expref: 27 pid: 6476 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869554.506018:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788869554.506025:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+27:3617:x1875765554643840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869554.506037:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869554.506042:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ff80030c00/0xbead52e175fc29b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc29aa expref: 27 pid: 6479 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.506062:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ff80030c00/0xbead52e175fc29b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc29aa expref: 27 pid: 6479 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.506076:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff80030c00/0xbead52e175fc29b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc29aa expref: 27 pid: 6479 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.506089:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869554.506119:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+26:3617:x1875765554643840:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869554.506125:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788869554.506139:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788869554.506145:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+25:3617:x1875765554643712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869554.506152:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869554.506156:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb95a8400/0xbead52e175fc2ad7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2ad0 expref: 25 pid: 6479 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.506163:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb95a8400/0xbead52e175fc2ad7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2ad0 expref: 25 pid: 6479 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.506173:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb95a8400/0xbead52e175fc2ad7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2ad0 expref: 25 pid: 6479 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.506182:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869554.506201:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554643712:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869554.506206:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788869554.506217:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788869554.506222:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+23:3618:x1875765554643968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869554.506235:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869554.506239:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ff80031200/0xbead52e175fc295d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2956 expref: 23 pid: 6478 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.506246:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ff80031200/0xbead52e175fc295d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2956 expref: 23 pid: 6478 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.506278:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff80031200/0xbead52e175fc295d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2956 expref: 23 pid: 6478 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.506287:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869554.506313:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+22:3618:x1875765554643968:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869554.506319:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788869554.506330:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788869554.506336:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+21:3618:x1875765554644096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869554.506343:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869554.506347:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ff80030000/0xbead52e175fc294f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2948 expref: 21 pid: 6476 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.506355:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ff80030000/0xbead52e175fc294f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2948 expref: 21 pid: 6476 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.506363:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff80030000/0xbead52e175fc294f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2948 expref: 21 pid: 6476 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.506371:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869554.506392:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+20:3618:x1875765554644096:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869554.506420:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788869554.506472:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8208a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554644096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869554.506480:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554643968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869554.506504:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554643712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869554.506512:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554643840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869554.515344:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10360:1875765554643072:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788869554.515383:0:10360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffb95a8c00/0xbead52e175fc2cb3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869554.520953:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869554.521564:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545146880 00000100:00100000:2.0:1788869554.521574:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545146880 00010000:00010000:2.0:1788869554.521610:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb95a8a00/0xbead52e175fc2bef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa8d3 expref: 10 pid: 6478 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869554.521651:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:2.0:1788869554.521662:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2388:x1875765545146880:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869554.521677:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869554.521683:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb95a8a00/0xbead52e175fc2bef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa8d3 expref: 10 pid: 6478 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.521696:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb95a8a00/0xbead52e175fc2bef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa8d3 expref: 10 pid: 6478 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.521715:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb95a8a00/0xbead52e175fc2bef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa8d3 expref: 10 pid: 6478 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.521742:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffb95a8c00/0xbead52e175fc2cb3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.521751:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb95a8c00/0xbead52e175fc2cb3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.521783:0:6469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffb95a8c00/0xbead52e175fc2cb3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.521791:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffb95a8c00/0xbead52e175fc2cb3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.521798:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffb95a8c00/0xbead52e175fc2cb3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.521805:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffb95a8c00/0xbead52e175fc2cb3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.521811:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a8c00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869554.521815:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffb95a8c00/0xbead52e175fc2cb3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.521823:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffb95a8c00/0xbead52e175fc2cb3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.521846:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffb95a8c00/0xbead52e175fc2cb3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869554.521859:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869554.522175:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3df077ce-aecd-4e92-8493-7099e13a8f7b+9:2388:x1875765545146880:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 254us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869554.522184:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 39 00010000:00010000:1.0:1788869554.522290:0:10360:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffb95a8c00/0xbead52e175fc2cb3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.522299:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffb95a8c00/0xbead52e175fc2cb3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869554.522306:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb95a8c00/0xbead52e175fc2cb3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869554.948166:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869554.948297:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545147008 00000100:00100000:0.0:1788869554.948315:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545147008 00000100:00100000:0.0:1788869554.948382:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 247 00000100:00100000:0.0:1788869554.948400:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+9:6155:x1875765545147008:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869554.948424:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869554.948448:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb98e2a00/0xbead52e175fc2cba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa919 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.948497:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb98e2a00/0xbead52e175fc2cba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa919 expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.948506:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb98e2a00/0xbead52e175fc2cba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa919 expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869554.948514:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb98e2a00, rc 0) 00000100:00100000:0.0:1788869554.948579:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:6155:x1875765545147008:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 189us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869554.948587:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 247 00000100:00100000:0.0:1788869554.954045:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869554.954106:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545147136 00000100:00100000:0.0:1788869554.954120:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545147136 00000100:00100000:0.0:1788869554.954192:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 248 00000100:00100000:0.0:1788869554.954204:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8a775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:6155:x1875765545147136:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869554.954453:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8a775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:6155:x1875765545147136:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 250us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869554.954462:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 248 00000100:00100000:3.0:1788869554.962028:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869554.962109:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545147264 00000100:00100000:0.0:1788869554.962128:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545147264 00000100:00100000:0.0:1788869554.962209:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 249 00000100:00100000:0.0:1788869554.962223:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8a777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:6155:x1875765545147264:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869554.962465:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8a777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:6155:x1875765545147264:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 244us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869554.962476:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 249 00000100:00100000:3.0:1788869554.965838:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869554.970048:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545147392 00000100:00100000:0.0:1788869554.970078:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545147392 00000100:00100000:0.0:1788869554.970182:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 250 00000100:00100000:0.0:1788869554.970199:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8a775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:6699:x1875765545147392:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788869554.970484:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8a775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:6699:x1875765545147392:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 290us (4655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869554.970495:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 250 00000100:00100000:1.0:1788869554.974677:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869554.975005:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545147520 00000100:00100000:0.0:1788869554.975019:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545147520 00000100:00100000:0.0:1788869554.975099:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 251 00000100:00100000:0.0:1788869554.975112:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff994d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:6699:x1875765545147520:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788869554.975336:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff994d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:6699:x1875765545147520:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 225us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869554.975347:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 251 00000100:00100000:2.0:1788869555.096950:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869555.096973:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554644224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869555.097054:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869555.097127:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554644224 00000100:00100000:2.0:1788869555.097134:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554644224 00000100:00100000:2.0:1788869555.097186:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788869555.097195:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554644224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788869555.097226:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869555.097295:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554644224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869555.097303:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788869555.097338:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ff84be5c00 x1875765554644224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869555.097357:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554644224:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788869555.098461:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788869555.098479:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869555.100554:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869555.100593:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554644352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869555.100658:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869555.101126:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554644352 00000100:00100000:3.0:1788869555.101134:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554644352 00000100:00100000:3.0:1788869555.101206:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788869555.101215:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf958e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554644352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869555.101236:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869555.101313:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf958e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554644352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869555.101321:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788869555.101359:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82cb6a00 x1875765554644352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869555.101380:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554644352:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788869555.101529:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869555.610710:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869555.613333:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554644480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869555.613494:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869555.616475:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554644480 00000100:00100000:2.0:1788869555.616488:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554644480 00000100:00100000:0.0:1788869555.618462:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788869555.618473:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554644480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869555.618507:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788869555.618589:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554644480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (5095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869555.618611:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788869555.618640:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554644480:0@lo:41:osp-pre-1-0.0 10000000:01000000:1.0:1788869555.936738:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788869555.936746:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ffb9bbc800 from 4 10000000:01000000:1.0:1788869555.936751:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869555.936800:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8a00/0xbead52e175fc2cc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.936812:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8a00/0xbead52e175fc2cc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.936834:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8a00/0xbead52e175fc2cc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869555.936860:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554644608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869555.937084:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869555.937133:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84fade40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869555.937206:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554644608 00000100:00100000:2.0:1788869555.937213:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554644608 00000100:00100000:2.0:1788869555.937278:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788869555.937288:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8d0e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+20:6481:x1875765554644608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869555.937299:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869555.937312:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2cc8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2cc1 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869555.937334:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2cc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2cc1 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869555.937344:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2cc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2cc1 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869555.937352:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534a00, rc 0) 00000100:00100000:2.0:1788869555.937404:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8d0e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554644608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869555.937410:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788869555.937453:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554644608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869555.937468:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8a00/0xbead52e175fc2cc1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2cc8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869555.937477:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8a00/0xbead52e175fc2cc1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2cc8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869555.937533:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554644736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869555.937557:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869555.937577:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89a980c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869555.937589:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554644736 00000100:00100000:2.0:1788869555.937592:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554644736 00000100:00100000:2.0:1788869555.937613:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788869555.937619:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554644736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869555.937717:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554644736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869555.937724:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788869555.937750:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554644736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869555.937778:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554644864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869555.937813:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869555.937826:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89a980c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869555.937837:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554644864 00000100:00100000:2.0:1788869555.937840:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554644864 00000100:00100000:2.0:1788869555.937881:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788869555.937887:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554644864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869555.937961:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554644864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869555.937967:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788869555.938004:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554644864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869555.938189:0:10448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10448:1875765554644992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869555.938219:0:10448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869555.938235:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554644992 00000100:00100000:2.0:1788869555.938238:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554644992 00000100:00100000:2.0:1788869555.938274:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788869555.938281:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+21:10448:x1875765554644992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869555.938351:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+21:10448:x1875765554644992:12345-0@lo:502:llog_process_th.0 Request processed in 70us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869555.938359:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788869555.938399:0:10448:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89a98480 going to sleep for 11 seconds 00000100:00100000:2.0:1788869555.938410:0:10448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10448:1875765554644992:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788869555.938428:0:10448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869555.938436:0:10448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869555.938438:0:10448:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788869555.938446:0:10448:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffb9bbc800 00000020:00000080:2.0:1788869555.938448:0:10448:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788869555.938520:0:10448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10448:1875765554645120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869555.938551:0:10448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869555.940310:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554645120 00000100:00100000:1.0:1788869555.940320:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554645120 00000100:00100000:1.0:1788869555.940361:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788869555.940369:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:10448:x1875765554645120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869555.940481:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:10448:x1875765554645120:12345-0@lo:502:llog_process_th.0 Request processed in 113us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869555.940488:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788869555.940790:0:10448:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff855663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869555.940812:0:10448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10448:1875765554645120:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788869555.940846:0:10448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869555.940853:0:10448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869555.940855:0:10448:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788869555.940860:0:10448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788869555.941220:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788869555.941242:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869555.941407:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8a00/0xbead52e175fc2cc1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2cc8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.941420:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8a00/0xbead52e175fc2cc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2cc8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869555.941431:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788869555.941434:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ffc10cf800 from 4 10000000:01000000:1.0:1788869555.941436:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869555.941464:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2ccf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.941472:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2ccf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.941491:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2ccf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869555.941510:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554645248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869555.941550:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869555.941567:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84fade40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869555.941581:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554645248 00000100:00100000:1.0:1788869555.941585:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554645248 00000100:00100000:1.0:1788869555.941607:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788869555.941612:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554645248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869555.941621:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869555.941632:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb95a8400/0xbead52e175fc2cd6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2ccf expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.941651:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb95a8400/0xbead52e175fc2cd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2ccf expref: 22 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.941660:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb95a8400/0xbead52e175fc2cd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2ccf expref: 22 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.941668:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a8400, rc 0) 00000100:00100000:1.0:1788869555.941695:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554645248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869555.941701:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788869555.941731:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554645248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869555.941743:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2ccf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2cd6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.941756:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2ccf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2cd6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869555.941799:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554645376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869555.941822:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869555.941834:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84fade40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869555.941846:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554645376 00000100:00100000:1.0:1788869555.941849:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554645376 00000100:00100000:1.0:1788869555.943020:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788869555.943034:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554645376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869555.943200:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554645376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869555.943207:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788869555.950495:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554645376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869555.951365:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554645504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869555.951456:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869555.951495:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff855663c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869555.951618:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554645504 00000100:00100000:1.0:1788869555.951626:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554645504 00000100:00100000:1.0:1788869555.951709:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788869555.951718:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554645504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869555.951829:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554645504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869555.951837:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788869555.956652:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554645504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869555.956847:0:10452:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf901500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10452:1875765554645632:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869555.956916:0:10452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869555.956958:0:10452:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43180 going to sleep for 11 seconds 00000100:00100000:0.0:1788869555.958311:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554645632 00000100:00100000:0.0:1788869555.958323:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554645632 00000100:00100000:0.0:1788869555.959488:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788869555.959501:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+22:10452:x1875765554645632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869555.959650:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+22:10452:x1875765554645632:12345-0@lo:502:llog_process_th.0 Request processed in 152us (2734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869555.959657:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788869555.959720:0:10452:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf901500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10452:1875765554645632:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788869555.959752:0:10452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869555.959763:0:10452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869555.959765:0:10452:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788869555.959771:0:10452:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffc10cf800 00000020:00000080:0.0:1788869555.959773:0:10452:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788869555.959859:0:10452:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf901500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10452:1875765554645760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869555.959915:0:10452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869555.959941:0:10452:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43180 going to sleep for 11 seconds 00000100:00100000:3.0:1788869555.959947:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554645760 00000100:00100000:3.0:1788869555.959952:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554645760 00000100:00100000:3.0:1788869555.959992:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788869555.959999:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+22:10452:x1875765554645760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869555.960094:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+22:10452:x1875765554645760:12345-0@lo:502:llog_process_th.0 Request processed in 95us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869555.960101:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788869555.962213:0:10452:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf901500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10452:1875765554645760:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788869555.962248:0:10452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869555.962273:0:10452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869555.962275:0:10452:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788869555.962284:0:10452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788869555.962405:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788869555.962428:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788869555.962438:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2ccf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2cd6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.962451:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2ccf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2cd6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869555.962461:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788869555.962463:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ff89980800 from 4 10000000:01000000:0.0:1788869555.962466:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788869555.962493:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2200/0xbead52e175fc2cdd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.962501:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2200/0xbead52e175fc2cdd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869555.962510:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2200/0xbead52e175fc2cdd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869555.962532:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf901500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554645888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869555.962589:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869555.962626:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43180 going to sleep for 11 seconds 00000100:00100000:3.0:1788869555.963231:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554645888 00000100:00100000:3.0:1788869555.963239:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554645888 00000100:00100000:3.0:1788869555.963299:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788869555.963308:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554645888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869555.963321:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869555.963335:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb9a9f600/0xbead52e175fc2ce4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2cdd expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.963378:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb9a9f600/0xbead52e175fc2ce4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2cdd expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.963390:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb9a9f600/0xbead52e175fc2ce4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2cdd expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.963399:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9f600, rc 0) 00000100:00100000:3.0:1788869555.963445:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554645888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869555.963453:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788869555.963495:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf901500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554645888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869555.963508:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2200/0xbead52e175fc2cdd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2ce4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.963518:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2200/0xbead52e175fc2cdd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2ce4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869555.963579:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554646016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869555.963608:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869555.963622:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff885fa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869555.963634:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554646016 00000100:00100000:3.0:1788869555.963636:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554646016 00000100:00100000:3.0:1788869555.963670:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788869555.963677:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554646016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869555.963780:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554646016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869555.963788:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788869555.963812:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554646016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869555.963837:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554646144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869555.963868:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869555.963881:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff885fa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869555.963890:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554646144 00000100:00100000:3.0:1788869555.963893:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554646144 00000100:00100000:3.0:1788869555.963911:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788869555.963916:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554646144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869555.963991:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554646144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869555.963997:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788869555.964031:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554646144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869555.964523:0:10455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10455:1875765554646272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869555.964563:0:10455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869555.964618:0:10455:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff885fa000 going to sleep for 11 seconds 00000100:00100000:2.0:1788869555.966714:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554646272 00000100:00100000:2.0:1788869555.966727:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554646272 00000100:00100000:3.0:1788869555.971590:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788869555.971606:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+23:10455:x1875765554646272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869555.971773:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+23:10455:x1875765554646272:12345-0@lo:502:llog_process_th.0 Request processed in 171us (7208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869555.971780:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788869555.971904:0:10455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10455:1875765554646272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788869555.971937:0:10455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869555.971945:0:10455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869555.971948:0:10455:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788869555.971955:0:10455:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ff89980800 00000020:00000080:3.0:1788869555.971958:0:10455:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788869555.972083:0:10455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10455:1875765554646400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869555.972125:0:10455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869555.972148:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554646400 00000100:00100000:3.0:1788869555.972154:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554646400 00000100:00100000:3.0:1788869555.972180:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788869555.974926:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+23:10455:x1875765554646400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869555.975085:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+23:10455:x1875765554646400:12345-0@lo:502:llog_process_th.0 Request processed in 2893us (2954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869555.975095:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788869555.975177:0:10455:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe810db9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869555.975203:0:10455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10455:1875765554646400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788869555.975235:0:10455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869555.975247:0:10455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869555.975276:0:10455:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788869555.975283:0:10455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788869555.977450:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788869555.977523:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788869555.977535:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2200/0xbead52e175fc2cdd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2ce4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.977548:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2200/0xbead52e175fc2cdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2ce4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869555.977560:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788869555.977562:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ff8b15e800 from 4 10000000:01000000:3.0:1788869555.977565:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788869555.977600:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc2ceb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.977608:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc2ceb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869555.977620:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc2ceb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869555.977644:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554646528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788869555.977709:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869555.978409:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89afb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869555.982867:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554646528 00000100:00100000:1.0:1788869555.982882:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554646528 00000100:00100000:1.0:1788869555.982942:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788869555.982952:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554646528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869555.982970:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869555.982993:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb95a9400/0xbead52e175fc2cf2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2ceb expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.983022:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb95a9400/0xbead52e175fc2cf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2ceb expref: 24 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.983034:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb95a9400/0xbead52e175fc2cf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2ceb expref: 24 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.983044:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a9400, rc 0) 00000100:00100000:1.0:1788869555.983125:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554646528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (5415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869555.983132:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788869555.984294:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554646528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869555.984315:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc2ceb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2cf2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.984326:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc2ceb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2cf2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869555.984485:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554646656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869555.984532:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869555.984570:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae5fe000 going to sleep for 11 seconds 00000100:00100000:2.0:1788869555.984692:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554646656 00000100:00100000:2.0:1788869555.984699:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554646656 00000100:00100000:2.0:1788869555.984986:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788869555.984995:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554646656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869555.985112:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554646656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869555.985120:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788869555.985551:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554646656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869555.985582:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554646784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869555.985615:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869555.985641:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae5fe000 going to sleep for 11 seconds 00000100:00100000:0.0:1788869555.985653:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554646784 00000100:00100000:0.0:1788869555.985659:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554646784 00000100:00100000:0.0:1788869555.985688:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788869555.985694:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554646784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869555.985783:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554646784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869555.985790:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554646784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869555.985798:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788869555.986278:0:10461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf900380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10461:1875765554646912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869555.986313:0:10461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869555.986340:0:10461:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869555.987326:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554646912 00000100:00100000:0.0:1788869555.987334:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554646912 00000100:00100000:0.0:1788869555.987379:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788869555.987388:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:10461:x1875765554646912:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869555.987507:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:10461:x1875765554646912:12345-0@lo:502:llog_process_th.0 Request processed in 119us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869555.987514:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788869555.987564:0:10461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf900380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10461:1875765554646912:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788869555.987590:0:10461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869555.987599:0:10461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869555.987602:0:10461:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788869555.987607:0:10461:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ff8b15e800 00000020:00000080:0.0:1788869555.987610:0:10461:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788869555.987695:0:10461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf900380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10461:1875765554647040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869555.987733:0:10461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869555.987756:0:10461:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869555.988598:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554647040 00000100:00100000:2.0:1788869555.988606:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554647040 00000100:00100000:2.0:1788869555.988641:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788869555.988650:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:10461:x1875765554647040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869555.988755:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:10461:x1875765554647040:12345-0@lo:502:llog_process_th.0 Request processed in 107us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869555.988762:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788869555.988809:0:10461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf900380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:10461:1875765554647040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788869555.988832:0:10461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869555.988843:0:10461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869555.988845:0:10461:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788869555.988852:0:10461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788869555.991062:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788869555.991100:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869555.991111:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc2ceb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2cf2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869555.991123:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc2ceb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2cf2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869556.121341:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869557.146594:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869557.146952:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869557.147406:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf903b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554647168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869557.147516:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869557.147846:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554647168 00000100:00100000:3.0:1788869557.147857:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554647168 00000100:00100000:3.0:1788869557.147956:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788869557.147968:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf95bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554647168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869557.148023:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788869557.148090:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf95bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554647168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869557.148099:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788869557.148185:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf903b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554647168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869557.351777:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869557.351836:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869557.351872:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869557.351903:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869557.351933:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869557.351970:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545148160 00000100:00100000:3.0:1788869557.351985:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545148160 00000100:00100000:3.0:1788869557.352066:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545148032 00000100:00100000:3.0:1788869557.352070:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545148032 00000100:00100000:3.0:1788869557.352102:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:3.0:1788869557.352115:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545148160:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869557.352228:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545148160:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 115us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869557.352236:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:3.0:1788869557.352285:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:3.0:1788869557.352294:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545148032:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869557.352326:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545148032:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869557.352333:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:3.0:1788869557.352365:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545147904 00000100:00100000:3.0:1788869557.352370:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545147904 00000100:00100000:3.0:1788869557.352403:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545147776 00000100:00100000:3.0:1788869557.352416:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545147776 00000100:00100000:3.0:1788869557.352446:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:3.0:1788869557.352455:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545147904:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869557.352466:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:2.0:1788869557.352479:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+6:2390:x1875765545147776:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869557.352513:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545147904:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 59us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869557.352522:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00080000:3.0:1788869557.352553:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869557.352559:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869557.352563:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869557.352566:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869557.352692:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+6:2390:x1875765545147776:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 216us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869557.352701:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:1.0:1788869557.352820:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545147648 00000100:00100000:1.0:1788869557.352826:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545147648 00000100:00100000:1.0:1788869557.352858:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 272 00000100:00100000:1.0:1788869557.352865:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2390:x1875765545147648:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869557.352911:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2390:x1875765545147648:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 46us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869557.352918:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 272 00000100:00100000:2.0:1788869557.656933:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875765554647424:0@lo:400:kworker.0 00000100:00100000:1.0:1788869557.656967:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554647552:0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.660202:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869557.660325:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554647936:0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.660391:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869557.660412:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554647680:0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.660424:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554648448:0@lo:400:kworker.0 00000100:00100000:1.0:1788869557.660448:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869557.660461:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869557.660469:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554648192:0@lo:400:kworker.0 00000100:00100000:1.0:1788869557.660494:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869557.660512:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788869557.660518:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554648704:0@lo:400:kworker.0 00000100:00100000:1.0:1788869557.660542:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869557.660694:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554647680 00000100:00100000:0.0:1788869557.660704:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554647680 00000100:00100000:0.0:1788869557.660761:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788869557.660771:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554647680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869557.660852:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554647680:12345-0@lo:400:kworker.0 Request processed in 81us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869557.660860:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788869557.660939:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554647680:0@lo:400:kworker.0 00000100:00100000:0.0:1788869557.660957:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf903b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554648832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869557.660977:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869557.660999:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554648832 00000100:00100000:0.0:1788869557.661002:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554648832 00000100:00100000:0.0:1788869557.661039:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788869557.661045:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf903800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554648832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869557.661076:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869557.661113:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf903800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554648832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869557.661120:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788869557.661134:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788869557.661154:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf903b80 x1875765554648832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869573 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869557.661167:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf903b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554648832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869557.661220:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554647296:0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.661432:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869557.661751:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875765554647808:0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.661782:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869557.662761:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554647296 00000100:00100000:0.0:1788869557.662770:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554647296 00000100:00100000:0.0:1788869557.662822:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788869557.662829:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554647296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869557.662882:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554647296:12345-0@lo:400:kworker.0 Request processed in 54us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869557.662887:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788869557.664225:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554648192 00000100:00100000:1.0:1788869557.664236:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554648192 00000100:00100000:1.0:1788869557.664297:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554648704 00000100:00100000:1.0:1788869557.664299:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554648704 00000100:00100000:1.0:1788869557.664316:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788869557.664322:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554648192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869557.664415:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554648192:12345-0@lo:400:kworker.0 Request processed in 93us (3919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869557.664420:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788869557.664432:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788869557.664436:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554648704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869557.664456:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554648704:12345-0@lo:400:kworker.0 Request processed in 20us (3914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869557.664459:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788869557.664477:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869557.664512:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839c9880 x1875765554648192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869557.664525:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554648192:0@lo:400:kworker.0 00010000:00080000:1.0:1788869557.664534:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839ca680 x1875765554648704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869557.664540:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554648704:0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.666204:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1875765554648320:0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.666295:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869557.671363:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554647424 00000100:00100000:3.0:1788869557.671384:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554647424 00000100:00100000:3.0:1788869557.671455:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554647936 00000100:00100000:3.0:1788869557.671458:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554647936 00000100:00100000:3.0:1788869557.671485:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554648448 00000100:00100000:3.0:1788869557.671488:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554648448 00000100:00100000:3.0:1788869557.671496:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554647808 00000100:00100000:3.0:1788869557.671497:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554647808 00000100:00100000:3.0:1788869557.671513:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788869557.671520:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875765554647424:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788869557.671667:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869557.671673:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869557.671911:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554647296:0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.671954:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554648320 00000100:00100000:2.0:1788869557.671959:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554648320 00000100:00100000:2.0:1788869557.672013:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788869557.672042:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554647936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.672125:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554647936:12345-0@lo:400:kworker.0 Request processed in 96us (11733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869557.672132:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788869557.672216:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788869557.672225:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875765554648448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.672294:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875765554648448:12345-0@lo:400:kworker.0 Request processed in 70us (11833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869557.672301:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788869557.672315:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788869557.672322:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875765554647808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.672365:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875765554647808:12345-0@lo:400:kworker.0 Request processed in 44us (10582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869557.672372:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788869557.672384:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788869557.672392:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875765554648320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.672427:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875765554648320:12345-0@lo:400:kworker.0 Request processed in 36us (6133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869557.672433:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788869557.672784:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875765554647424:12345-0@lo:400:kworker.0 Request processed in 1262us (12591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869557.672792:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788869557.672852:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869557.672892:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554648064:0@lo:400:kworker.0 00000100:00100000:3.0:1788869557.672924:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869557.672945:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554648576:0@lo:400:kworker.0 00000100:00100000:3.0:1788869557.672960:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869557.673011:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554647552 00000100:00100000:3.0:1788869557.673015:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554647552 00000100:00100000:3.0:1788869557.673036:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788869557.673041:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554647552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869557.673069:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554647552:12345-0@lo:400:kworker.0 Request processed in 28us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869557.673073:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788869557.673095:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554647552:0@lo:400:kworker.0 00000100:00100000:1.0:1788869557.673766:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554648064 00000100:00100000:1.0:1788869557.673773:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554648064 00000100:00100000:1.0:1788869557.673849:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554648576 00000100:00100000:1.0:1788869557.673852:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554648576 00000100:00100000:0.0:1788869557.676697:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788869557.676718:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554648064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869557.676853:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554648064:12345-0@lo:400:kworker.0 Request processed in 143us (3927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869557.676861:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788869557.676887:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788869557.676894:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554648576:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788869557.676920:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869557.676920:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554648576:12345-0@lo:400:kworker.0 Request processed in 28us (3959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869557.676927:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788869557.676932:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788869557.676938:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788869557.676974:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf95a300 x1875765554648064/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869557.676989:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554648064:0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.676992:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875765554647808:0@lo:400:kworker.0 00010000:00080000:0.0:1788869557.677003:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839c8e00 x1875765554648576/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869557.677011:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554648576:0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.677018:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1875765554648320:0@lo:400:kworker.0 00000100:00100000:2.0:1788869557.677050:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875765554647424:0@lo:400:kworker.0 00010000:00080000:2.0:1788869557.677081:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf95a680 x1875765554647936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869557.677094:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554647936:0@lo:400:kworker.0 00010000:00080000:2.0:1788869557.677110:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839c9f80 x1875765554648448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869557.677120:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554648448:0@lo:400:kworker.0 00010000:00010000:1.0:1788869558.168800:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869558.170002:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869558.170033:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554648960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869558.170141:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869558.170206:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554648960 00000100:00100000:3.0:1788869558.170219:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554648960 00000100:00100000:3.0:1788869558.170308:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788869558.170334:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554648960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869558.170411:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869558.170502:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554648960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 178us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869558.170514:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788869558.170554:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839ca680 x1875765554648960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869558.170585:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554648960:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1788869559.068057:0:10660:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1788869559.192611:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869560.216879:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554649088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869560.216970:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869560.217206:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869560.217294:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554649216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869560.217326:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869560.217525:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554649088 00000100:00100000:2.0:1788869560.217533:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554649088 00000100:00100000:2.0:1788869560.217582:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554649216 00000100:00100000:2.0:1788869560.217584:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554649216 00000100:00100000:2.0:1788869560.217596:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788869560.217604:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf903b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554649088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869560.217638:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869560.217696:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf903b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554649088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869560.217703:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788869560.217721:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788869560.217727:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554649216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788869560.217737:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869560.217761:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554649216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869560.217767:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788869560.217885:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839ce680 x1875765554649088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869560.217906:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554649088:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788869560.217967:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869560.217989:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82089c00 x1875765554649216/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869560.218003:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554649216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869560.728459:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869560.728566:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554649344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869560.728634:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869560.728749:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554649344 00000100:00100000:1.0:1788869560.728757:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554649344 00000100:00100000:1.0:1788869560.728804:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788869560.728814:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554649344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788869560.728848:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788869560.728891:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554649344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869560.728898:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788869560.729062:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554649344:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788869561.240884:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869562.266619:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869562.269668:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869562.269693:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554649472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869562.269778:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869562.269850:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554649472 00000100:00100000:1.0:1788869562.269859:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554649472 00000100:00100000:1.0:1788869562.269906:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788869562.269915:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554649472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869562.269949:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788869562.269995:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554649472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869562.270002:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788869562.270046:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554649472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869562.471168:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869562.471229:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869562.471275:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545148288 00000100:00100000:3.0:1788869562.471286:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545148288 00000100:00100000:2.0:1788869562.471292:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869562.471320:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869562.471347:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 274 00000100:00100000:3.0:1788869562.471359:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2389:x1875765545148288:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869562.471369:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869562.471398:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545148672 00000100:00100000:2.0:1788869562.471404:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545148672 00000100:00100000:2.0:1788869562.471450:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545148800 00000100:00100000:2.0:1788869562.471454:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545148800 00000100:00100000:3.0:1788869562.471462:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2389:x1875765545148288:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 94us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869562.471471:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 274 00000100:00100000:2.0:1788869562.471479:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:2.0:1788869562.471490:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8208b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545148672:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869562.471510:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545148544 00000100:00100000:3.0:1788869562.471514:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545148544 00000100:00100000:2.0:1788869562.471527:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8208b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545148672:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 39us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869562.471535:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:3.0:1788869562.471546:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545148416 00000100:00100000:3.0:1788869562.471550:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545148416 00000100:00100000:2.0:1788869562.471554:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:2.0:1788869562.471563:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8208ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545148800:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869562.471580:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 75 00000100:00100000:3.0:1788869562.471589:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545148544:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869562.471605:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8208ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545148800:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 42us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869562.471613:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:3.0:1788869562.471625:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545148544:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 37us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869562.471633:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 75 00000100:00080000:2.0:1788869562.471636:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869562.471641:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869562.471644:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869562.471647:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869562.471652:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 76 00000100:00100000:3.0:1788869562.471660:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8208a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+6:2389:x1875765545148416:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869562.471685:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8208a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+6:2389:x1875765545148416:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869562.471691:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 76 00000100:00100000:1.0:1788869562.776503:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554649728:0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.776598:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869562.776641:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554650240:0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.776659:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869562.776669:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554650752:0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.776681:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869562.776701:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788869562.776705:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554649600:0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.776723:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869562.776740:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554650112:0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.776758:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869562.776775:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875765554650624:0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.776794:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869562.776810:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554649856:0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.776832:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869562.776839:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554650368:0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.776851:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869562.776862:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554650880:0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.776873:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869562.776889:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788869562.776893:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554649984:0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.776907:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869562.776916:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554650496:0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.776929:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869562.776938:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554651008:0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.776949:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869562.776970:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554649728 00000100:00100000:1.0:1788869562.776975:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554649728 00000100:00100000:1.0:1788869562.777001:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554650240 00000100:00100000:1.0:1788869562.777002:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554650240 00000100:00100000:1.0:1788869562.777016:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554650752 00000100:00100000:1.0:1788869562.777018:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554650752 00000100:00100000:1.0:1788869562.777023:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554650112 00000100:00100000:1.0:1788869562.777025:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554650112 00000100:00100000:1.0:1788869562.777036:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554650624 00000100:00100000:1.0:1788869562.777038:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554650624 00000100:00100000:1.0:1788869562.777048:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554649856 00000100:00100000:1.0:1788869562.777050:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554649856 00000100:00100000:1.0:1788869562.777063:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788869562.777071:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554649728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.777117:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554649728:12345-0@lo:400:kworker.0 Request processed in 46us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869562.777132:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788869562.777149:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788869562.777155:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875765554650240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.777186:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875765554650240:12345-0@lo:400:kworker.0 Request processed in 31us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869562.777192:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788869562.777203:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788869562.777210:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875765554650752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.777248:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875765554650752:12345-0@lo:400:kworker.0 Request processed in 39us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869562.777275:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788869562.777287:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788869562.777292:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554650112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.777312:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554650112:12345-0@lo:400:kworker.0 Request processed in 21us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869562.777316:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788869562.777322:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788869562.777325:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875765554650624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.777338:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875765554650624:12345-0@lo:400:kworker.0 Request processed in 13us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869562.777342:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788869562.777347:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788869562.777350:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554649856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.777366:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554649856:12345-0@lo:400:kworker.0 Request processed in 16us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869562.777375:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788869562.777392:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554649600 00000100:00100000:1.0:1788869562.777395:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554649600 00000100:00100000:1.0:1788869562.777411:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788869562.777415:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:3619:x1875765554649600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.777436:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:3619:x1875765554649600:12345-0@lo:400:kworker.0 Request processed in 21us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869562.777440:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788869562.777470:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554650368 00000100:00100000:1.0:1788869562.777472:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554650368 00000100:00100000:1.0:1788869562.777485:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554650880 00000100:00100000:1.0:1788869562.777487:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554650880 00000100:00100000:1.0:1788869562.777492:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554650496 00000100:00100000:1.0:1788869562.777494:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554650496 00000100:00100000:1.0:1788869562.777499:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554651008 00000100:00100000:1.0:1788869562.777501:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554651008 00000100:00100000:1.0:1788869562.777508:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788869562.777511:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554650368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.777530:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554650368:12345-0@lo:400:kworker.0 Request processed in 19us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869562.777533:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788869562.777539:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788869562.777542:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554650880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.777557:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554650880:12345-0@lo:400:kworker.0 Request processed in 15us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869562.777560:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788869562.777565:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788869562.777573:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554650496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.777598:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554650496:12345-0@lo:400:kworker.0 Request processed in 25us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869562.777602:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788869562.777696:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788869562.777700:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554651008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.777715:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554651008:12345-0@lo:400:kworker.0 Request processed in 15us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869562.777718:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788869562.777731:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554649984 00000100:00100000:1.0:1788869562.777734:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554649984 00000100:00100000:1.0:1788869562.777757:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788869562.777763:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554649984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.777793:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554649984:12345-0@lo:400:kworker.0 Request processed in 30us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869562.777799:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788869562.777822:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869562.777826:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869562.777829:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869562.777831:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869562.777864:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554649984:0@lo:400:kworker.0 00010000:00080000:1.0:1788869562.777879:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839c9180 x1875765554650496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869562.777890:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554650496:0@lo:400:kworker.0 00010000:00080000:1.0:1788869562.777909:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839c8e00 x1875765554651008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869562.777924:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554651008:0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.777931:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554649856:0@lo:400:kworker.0 00010000:00080000:1.0:1788869562.777937:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839cb800 x1875765554650368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869562.777942:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554650368:0@lo:400:kworker.0 00010000:00080000:1.0:1788869562.777946:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839cad80 x1875765554650880/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869562.777950:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554650880:0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.777973:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554649600:0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.777979:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554650112:0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.777985:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875765554650624:0@lo:400:kworker.0 00000100:00100000:1.0:1788869562.777990:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554649728:0@lo:400:kworker.0 00010000:00080000:1.0:1788869562.777995:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839cbb80 x1875765554650240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869562.778001:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554650240:0@lo:400:kworker.0 00010000:00080000:1.0:1788869562.778006:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839c9f80 x1875765554650752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869562.778010:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554650752:0@lo:400:kworker.0 00000100:00100000:2.0:1788869562.780666:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8208b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554651136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869562.780737:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869562.780786:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554651136 00000100:00100000:2.0:1788869562.780792:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554651136 00000100:00100000:2.0:1788869562.780836:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788869562.780853:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8208ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554651136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869562.780882:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869562.780925:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8208ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554651136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869562.780932:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788869562.780968:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8208b800 x1875765554651136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869578 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869562.780986:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8208b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554651136:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788869562.955214:0:10903:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing yml_node 00010000:00010000:3.0:1788869563.289183:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869563.293980:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554651264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869563.294062:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869563.294293:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554651264 00000100:00100000:3.0:1788869563.294301:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554651264 00000100:00100000:3.0:1788869563.294352:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788869563.294362:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8208b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554651264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869563.294384:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869563.296868:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8208b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554651264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2497us (2795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869563.296895:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788869563.297085:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf901180 x1875765554651264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869579 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869563.297110:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554651264:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788869564.312590:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869565.337655:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554651392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869565.337725:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869565.337960:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554651392 00000100:00100000:3.0:1788869565.337985:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554651392 00000100:00100000:3.0:1788869565.338046:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788869565.338056:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554651392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869565.338084:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869565.338126:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554651392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869565.338133:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:3.0:1788869565.338154:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788869565.338449:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869565.338481:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839bb100 x1875765554651392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869565.338500:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554651392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869565.341183:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869565.341204:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554651520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869565.341284:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869565.341324:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554651520 00000100:00100000:3.0:1788869565.341341:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554651520 00000100:00100000:3.0:1788869565.341390:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788869565.341398:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554651520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869565.341417:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869565.341467:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554651520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869565.341473:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788869565.341493:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788869565.341515:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839cea00 x1875765554651520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869565.341531:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554651520:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788869565.620881:0:11087:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.55.24 00000100:00100000:1.0:1788869565.850577:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554651648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869565.850651:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869565.850726:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554651648 00000100:00100000:1.0:1788869565.850733:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554651648 00000100:00100000:1.0:1788869565.850775:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788869565.850785:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554651648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788869565.850822:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788869565.850858:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554651648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869565.850865:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788869565.850906:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554651648:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788869566.361441:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869567.384905:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869567.391683:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554651776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869567.391757:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869567.393004:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554651776 00000100:00100000:3.0:1788869567.393025:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554651776 00000100:00100000:3.0:1788869567.393080:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788869567.393089:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf901880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554651776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869567.393125:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788869567.395644:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf901880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554651776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2545us (3876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869567.395658:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788869567.395771:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554651776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869567.614169:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869567.614243:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869567.614285:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869567.614309:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869567.614332:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869567.614340:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545149184 00000100:00100000:2.0:1788869567.614350:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545149184 00000100:00100000:1.0:1788869567.614350:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545149056 00000100:00100000:1.0:1788869567.614353:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545149056 00000100:00100000:1.0:1788869567.614402:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 83 00000100:00100000:1.0:1788869567.614418:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+6:2388:x1875765545149056:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869567.614502:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+6:2388:x1875765545149056:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 91us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869567.615185:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545148928 00000100:00100000:3.0:1788869567.615191:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545148928 00000100:00100000:3.0:1788869567.615225:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 276 00000100:00100000:3.0:1788869567.615233:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2387:x1875765545148928:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869567.615283:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2387:x1875765545148928:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 50us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869567.615289:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 276 00000100:00100000:2.0:1788869567.618907:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00080000:0.0:1788869567.619385:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869567.619393:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869567.619411:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545149312 00000100:00100000:0.0:1788869567.619419:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545149312 00000100:00100000:0.0:1788869567.619477:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545149440 00000100:00100000:0.0:1788869567.619479:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545149440 00000100:00100000:0.0:1788869567.619500:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:0.0:1788869567.619508:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2386:x1875765545149312:12345-192.168.201.30@tcp:9:kworker.0 00000020:00000080:0.0:1788869567.619544:0:8400:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2c04 00000100:00080000:0.0:1788869567.619553:0:8400:0:(import.c:65:import_set_state_nolock()) ffff99fe8337b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788869567.619598:0:8400:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788869567.619792:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+2:2386:x1875765545149312:12345-192.168.201.30@tcp:9:kworker.0 Request processed in 284us (5481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869567.619800:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:0.0:1788869567.619814:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:0.0:1788869567.619820:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2386:x1875765545149440:12345-192.168.201.30@tcp:9:kworker.0 00000020:00000080:0.0:1788869567.619833:0:8400:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2c0b 00000100:00080000:0.0:1788869567.619839:0:8400:0:(import.c:65:import_set_state_nolock()) ffff99fe82cab000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788869567.619860:0:8400:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788869567.620174:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+2:2386:x1875765545149440:12345-192.168.201.30@tcp:9:kworker.0 Request processed in 352us (5839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869567.620181:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00080000:0.0:1788869567.620355:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869567.620359:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788869567.620384:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869567.620389:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869567.620674:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545149184:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869567.620714:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545149184:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 1795us (6471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869567.620722:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00100000:1.0:1788869567.620912:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 83 00000001:02000400:2.0:1788869567.892832:0:11184:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.55.24 00000100:00100000:1.0:1788869567.896479:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554652288:0@lo:400:kworker.0 00000100:00100000:1.0:1788869567.896548:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869567.896595:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554652800:0@lo:400:kworker.0 00000100:00100000:1.0:1788869567.896621:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869567.896648:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554653312:0@lo:400:kworker.0 00000100:00100000:1.0:1788869567.896668:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869567.896696:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788869567.896702:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875765554652160:0@lo:400:kworker.0 00000100:00100000:1.0:1788869567.896726:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869567.896747:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554652672:0@lo:400:kworker.0 00000100:00100000:1.0:1788869567.896767:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869567.896783:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554653184:0@lo:400:kworker.0 00000100:00100000:1.0:1788869567.896801:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869567.896828:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554652288 00000100:00100000:1.0:1788869567.896835:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554652288 00000100:00100000:1.0:1788869567.896876:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788869567.896884:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554652288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869567.897072:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554652288:12345-0@lo:400:kworker.0 Request processed in 187us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869567.897080:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788869567.897102:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554652800 00000100:00100000:1.0:1788869567.897105:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554652800 00000100:00100000:1.0:1788869567.897153:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554653312 00000100:00100000:1.0:1788869567.897157:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554653312 00000100:00100000:1.0:1788869567.897168:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554652672 00000100:00100000:1.0:1788869567.897170:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554652672 00000100:00100000:1.0:1788869567.897180:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554653184 00000100:00100000:1.0:1788869567.897182:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554653184 00000100:00100000:1.0:1788869567.897199:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788869567.897205:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554652800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869567.897238:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554652800:12345-0@lo:400:kworker.0 Request processed in 32us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869567.897245:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788869567.897284:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788869567.897291:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554653312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869567.897323:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554653312:12345-0@lo:400:kworker.0 Request processed in 33us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869567.897329:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788869567.897339:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788869567.897345:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554652672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869567.897374:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554652672:12345-0@lo:400:kworker.0 Request processed in 28us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869567.897381:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788869567.897391:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788869567.897396:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554653184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869567.897422:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554653184:12345-0@lo:400:kworker.0 Request processed in 25us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869567.897428:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788869567.897453:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554652160 00000100:00100000:1.0:1788869567.897463:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554652160 00000100:00100000:1.0:1788869567.897492:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788869567.897499:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875765554652160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869567.897530:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875765554652160:12345-0@lo:400:kworker.0 Request processed in 31us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869567.897538:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1788869567.897564:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869567.897568:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869567.897598:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875765554652160:0@lo:400:kworker.0 00010000:00080000:1.0:1788869567.897613:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82229f80 x1875765554652672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869567.897623:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554652672:0@lo:400:kworker.0 00010000:00080000:1.0:1788869567.897631:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffb8911880 x1875765554653184/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869567.897640:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554653184:0@lo:400:kworker.0 00000100:00100000:1.0:1788869567.897652:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554652288:0@lo:400:kworker.0 00010000:00080000:1.0:1788869567.897663:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffae6ac380 x1875765554652800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869567.897671:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554652800:0@lo:400:kworker.0 00010000:00080000:1.0:1788869567.897680:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffb8913800 x1875765554653312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869567.897687:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554653312:0@lo:400:kworker.0 00000100:00100000:2.0:1788869567.897827:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554651904:0@lo:400:kworker.0 00000100:00100000:2.0:1788869567.897863:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869567.897902:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875765554652416:0@lo:400:kworker.0 00000100:00100000:2.0:1788869567.897942:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869567.897958:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875765554652928:0@lo:400:kworker.0 00000100:00100000:2.0:1788869567.897976:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869567.897992:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788869567.897999:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554652032:0@lo:400:kworker.0 00000100:00100000:2.0:1788869567.898018:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869567.898036:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554652544:0@lo:400:kworker.0 00000100:00100000:2.0:1788869567.898053:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869567.898063:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554653056:0@lo:400:kworker.0 00000100:00100000:2.0:1788869567.898081:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869567.898106:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554652416 00000100:00100000:2.0:1788869567.898109:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554652416 00000100:00100000:1.0:1788869567.898687:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554652928 00000100:00100000:1.0:1788869567.898698:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554652928 00000100:00100000:2.0:1788869567.898773:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554652032 00000100:00100000:2.0:1788869567.898777:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554652032 00000100:00100000:2.0:1788869567.898789:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554652544 00000100:00100000:2.0:1788869567.898792:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554652544 00000100:00100000:1.0:1788869567.898825:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554653056 00000100:00100000:1.0:1788869567.898828:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554653056 00000100:00100000:1.0:1788869567.898843:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788869567.898849:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875765554652416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869567.898904:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875765554652416:12345-0@lo:400:kworker.0 Request processed in 54us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869567.899020:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788869567.899036:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788869567.899043:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554652032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869567.899072:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554652032:12345-0@lo:400:kworker.0 Request processed in 30us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869567.899077:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788869567.899093:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788869567.899099:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875765554652928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869567.899139:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875765554652928:12345-0@lo:400:kworker.0 Request processed in 40us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869567.899145:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788869567.899156:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788869567.899163:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554653056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869567.899189:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554653056:12345-0@lo:400:kworker.0 Request processed in 27us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869567.899195:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788869567.901367:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554651904 00000100:00100000:3.0:1788869567.901378:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554651904 00000100:00100000:3.0:1788869567.901430:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788869567.901439:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3616:x1875765554651904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869567.901512:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3616:x1875765554651904:12345-0@lo:400:kworker.0 Request processed in 74us (3648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869567.901519:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788869567.901587:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869567.901602:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554653440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869567.901635:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869567.901679:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554653440 00000100:00100000:3.0:1788869567.901683:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554653440 00000100:00100000:3.0:1788869567.901709:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788869567.901716:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554653440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788869567.901739:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869567.901776:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554653440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869567.901782:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788869567.901814:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839cea00 x1875765554653440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869583 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869567.901832:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554653440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869567.902222:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788869567.902230:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554652544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869567.902298:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554652544:12345-0@lo:400:kworker.0 Request processed in 69us (4243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869567.902304:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1788869567.902333:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869567.902338:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869567.902359:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554652032:0@lo:400:kworker.0 00010000:00080000:2.0:1788869567.902372:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8222a300 x1875765554652544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869567.902394:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554652544:0@lo:400:kworker.0 00010000:00080000:2.0:1788869567.902408:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffae6ad500 x1875765554653056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869567.902417:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554653056:0@lo:400:kworker.0 00000100:00100000:2.0:1788869567.902426:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554651904:0@lo:400:kworker.0 00000100:00100000:2.0:1788869567.902437:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875765554652416:0@lo:400:kworker.0 00000100:00100000:2.0:1788869567.902447:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875765554652928:0@lo:400:kworker.0 00000100:00100000:2.0:1788869568.408404:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869568.408427:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554653568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869568.408493:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869568.408553:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554653568 00000100:00100000:2.0:1788869568.408559:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554653568 00000100:00100000:2.0:1788869568.408601:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788869568.408608:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554653568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788869568.408629:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869568.408667:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554653568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869568.408674:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788869568.408707:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83835880 x1875765554653568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869584 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869568.408725:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554653568:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788869568.409066:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869569.433970:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869570.456526:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869570.456714:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869570.456743:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554653696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869570.456837:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869570.457121:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554653824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869570.457152:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869570.457470:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554653696 00000100:00100000:0.0:1788869570.457481:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554653696 00000100:00100000:0.0:1788869570.457554:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554653824 00000100:00100000:0.0:1788869570.457556:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554653824 00000100:00100000:0.0:1788869570.457576:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788869570.457586:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554653696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869570.457624:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788869570.457733:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869570.457773:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554653696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 187us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869570.457781:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788869570.457801:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788869570.457808:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554653824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788869570.457818:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869570.457842:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554653824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869570.457848:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788869570.458001:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839cea00 x1875765554653696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869570.458022:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554653696:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788869570.458114:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839cf480 x1875765554653824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869570.458128:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554653824:0@lo:13:osp-pre-0-1.0 00000001:02000400:1.0:1788869570.933078:0:11281:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.55.24 00000100:00100000:0.0:1788869570.970309:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869570.970352:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf902d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554653952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869570.970532:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869570.970638:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554653952 00000100:00100000:2.0:1788869570.970657:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554653952 00000100:00100000:2.0:1788869570.970713:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788869570.970724:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554653952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869570.970771:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869570.970831:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554653952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869570.970839:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788869570.970909:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf902d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554653952:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788869571.480511:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869572.507500:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869572.508236:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869572.508273:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554654080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869572.508337:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869572.508461:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554654080 00000100:00100000:2.0:1788869572.508470:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554654080 00000100:00100000:2.0:1788869572.508521:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788869572.508537:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554654080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869572.508571:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788869572.508618:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554654080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869572.508626:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788869572.508856:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554654080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869572.716296:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869572.716345:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869572.716378:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869572.716406:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545149824 00000100:00100000:3.0:1788869572.716415:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545149824 00000100:00100000:3.0:1788869572.716471:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545149696 00000100:00100000:3.0:1788869572.716475:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545149696 00000100:00100000:3.0:1788869572.716499:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 91 00000100:00100000:3.0:1788869572.716509:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:2388:x1875765545149824:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869572.716581:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:2388:x1875765545149824:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 74us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869572.716589:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 91 00000100:00100000:3.0:1788869572.716605:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 92 00000100:00100000:3.0:1788869572.716611:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:2388:x1875765545149696:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869572.716636:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:2388:x1875765545149696:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869572.716642:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 92 00000100:00080000:3.0:1788869572.716658:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869572.716663:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869572.716856:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545149568 00000100:00100000:1.0:1788869572.716862:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545149568 00000100:00100000:1.0:1788869572.716899:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 278 00000100:00100000:1.0:1788869572.716907:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2388:x1875765545149568:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869572.716942:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2388:x1875765545149568:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 35us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869572.716947:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 278 00000001:00100000:0.0:1788869573.018666:0:9476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bf4fff62-1855-4361-a244-1a23eb291d37 00000020:00000080:0.0:1788869573.018674:0:9476:0:(genops.c:906:class_export_put()) final put ffff99fe82cad000/bf4fff62-1855-4361-a244-1a23eb291d37 00000020:00000080:0.0:1788869573.018693:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe82cad000/bf4fff62-1855-4361-a244-1a23eb291d37 for lustre-OST0001 00000020:00000080:0.0:1788869573.018744:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99fe82cab000 for lustre-OST0001 00000100:00100000:2.0:1788869573.026108:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554654208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869573.026177:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869573.026276:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554654208 00000100:00100000:2.0:1788869573.026284:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554654208 00000100:00100000:2.0:1788869573.026336:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788869573.026346:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554654208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869573.026374:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869573.026419:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554654208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869573.026426:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1788869573.026461:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788869573.026491:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83836680 x1875765554654208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869573.026523:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554654208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869573.030704:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554654592:0@lo:400:kworker.0 00000100:00100000:0.0:1788869573.031053:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869573.031093:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554655104:0@lo:400:kworker.0 00000100:00100000:0.0:1788869573.031140:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869573.031157:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554655616:0@lo:400:kworker.0 00000100:00100000:0.0:1788869573.031174:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869573.031194:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788869573.031200:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf900380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875765554654464:0@lo:400:kworker.0 00000100:00100000:0.0:1788869573.031223:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869573.031237:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf902a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554654976:0@lo:400:kworker.0 00000100:00100000:0.0:1788869573.031281:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869573.031295:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554655488:0@lo:400:kworker.0 00000100:00100000:0.0:1788869573.031313:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869573.032184:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554654592 00000100:00100000:3.0:1788869573.032194:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554654592 00000100:00100000:3.0:1788869573.032230:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554654464 00000100:00100000:3.0:1788869573.032233:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554654464 00000100:00100000:3.0:1788869573.032242:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554654976 00000100:00100000:3.0:1788869573.032269:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554654976 00000100:00100000:3.0:1788869573.032289:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554655488 00000100:00100000:3.0:1788869573.032292:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554655488 00000100:00100000:3.0:1788869573.032306:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788869573.032314:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554654592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869573.032392:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554654592:12345-0@lo:400:kworker.0 Request processed in 79us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869573.032401:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788869573.032420:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788869573.032425:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf95aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875765554654464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869573.032451:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf95aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875765554654464:12345-0@lo:400:kworker.0 Request processed in 26us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869573.032456:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788869573.032466:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788869573.032471:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554654976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869573.032494:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554654976:12345-0@lo:400:kworker.0 Request processed in 23us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869573.032499:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788869573.032508:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788869573.032512:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875765554655488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869573.032533:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875765554655488:12345-0@lo:400:kworker.0 Request processed in 21us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869573.032537:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788869573.032576:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf900380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875765554654464:0@lo:400:kworker.0 00010000:00080000:3.0:1788869573.032588:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf902a00 x1875765554654976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869573.032597:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf902a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554654976:0@lo:400:kworker.0 00010000:00080000:3.0:1788869573.032606:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf958700 x1875765554655488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869573.032623:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554655488:0@lo:400:kworker.0 00000100:00100000:3.0:1788869573.032634:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554654592:0@lo:400:kworker.0 00000100:00100000:3.0:1788869573.032664:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf902d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554654336:0@lo:400:kworker.0 00000100:00100000:3.0:1788869573.032696:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869573.032723:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554654848:0@lo:400:kworker.0 00000100:00100000:3.0:1788869573.032746:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869573.032761:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875765554655360:0@lo:400:kworker.0 00000100:00100000:3.0:1788869573.032779:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869573.032795:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788869573.032802:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf900700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554654720:0@lo:400:kworker.0 00000100:00100000:3.0:1788869573.032841:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869573.032858:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554655232:0@lo:400:kworker.0 00000100:00100000:3.0:1788869573.032879:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869573.033473:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554655104 00000100:00100000:1.0:1788869573.033479:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554655104 00000100:00100000:1.0:1788869573.033508:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554655616 00000100:00100000:1.0:1788869573.033510:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554655616 00000100:00100000:1.0:1788869573.033528:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788869573.033534:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554655104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869573.033574:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554655104:12345-0@lo:400:kworker.0 Request processed in 41us (2433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869573.033580:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788869573.033592:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788869573.033597:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf95a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554655616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869573.033618:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf95a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554655616:12345-0@lo:400:kworker.0 Request processed in 21us (2443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869573.033623:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788869573.033649:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554654336 00000100:00100000:1.0:1788869573.033652:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554654336 00000100:00100000:1.0:1788869573.033671:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788869573.033676:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3619:x1875765554654336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869573.033702:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3619:x1875765554654336:12345-0@lo:400:kworker.0 Request processed in 26us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869573.033719:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788869573.033742:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554654720 00000100:00100000:1.0:1788869573.033745:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554654720 00000100:00100000:1.0:1788869573.033763:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788869573.033768:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554654720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869573.033794:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554654720:12345-0@lo:400:kworker.0 Request processed in 26us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869573.033799:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788869573.033937:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554654848 00000100:00100000:2.0:1788869573.033942:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554654848 00000100:00100000:2.0:1788869573.033968:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554655360 00000100:00100000:2.0:1788869573.033971:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554655360 00000100:00100000:2.0:1788869573.033986:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788869573.033992:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554654848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869573.034035:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554654848:12345-0@lo:400:kworker.0 Request processed in 43us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869573.034042:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788869573.034053:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788869573.034058:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875765554655360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869573.034086:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875765554655360:12345-0@lo:400:kworker.0 Request processed in 28us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869573.034091:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1788869573.034111:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869573.034115:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869573.034117:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788869573.034119:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788869573.034393:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf902680 x1875765554655104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869573.034406:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554655104:0@lo:400:kworker.0 00010000:00080000:1.0:1788869573.034416:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf95a680 x1875765554655616/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869573.034425:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554655616:0@lo:400:kworker.0 00000100:00100000:3.0:1788869573.037216:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf902d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554654336:0@lo:400:kworker.0 00000100:00100000:3.0:1788869573.037238:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554654848:0@lo:400:kworker.0 00000100:00100000:3.0:1788869573.037248:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875765554655360:0@lo:400:kworker.0 00000100:00100000:3.0:1788869573.037289:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf900700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554654720:0@lo:400:kworker.0 00000100:00100000:1.0:1788869573.038145:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554655232 00000100:00100000:1.0:1788869573.038152:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554655232 00000100:00100000:1.0:1788869573.038235:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788869573.038245:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554655232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869573.038346:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554655232:12345-0@lo:400:kworker.0 Request processed in 103us (5466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869573.038365:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1788869573.038397:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf901f80 x1875765554655232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869573.038408:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554655232:0@lo:400:kworker.0 00000100:00080000:2.0:1788869573.038526:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1788869573.067152:0:8393:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bf4fff62-1855-4361-a244-1a23eb291d37 00000020:00000080:2.0:1788869573.067161:0:8393:0:(genops.c:906:class_export_put()) final put ffff99fe8337a000/bf4fff62-1855-4361-a244-1a23eb291d37 00000020:00000080:1.0:1788869573.067232:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe8337a000/bf4fff62-1855-4361-a244-1a23eb291d37 for lustre-OST0000 00000020:00000080:1.0:1788869573.076379:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99fe8337b000 for lustre-OST0000 00000001:02000400:3.0:1788869573.531744:0:11330:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 8 08:12:51 EDT 2026 00010000:00010000:0.0:1788869573.531870:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869573.540415:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554655744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869573.540489:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869573.540618:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554655744 00000100:00100000:0.0:1788869573.540627:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554655744 00000100:00100000:0.0:1788869573.540682:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788869573.540692:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554655744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869573.540717:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869573.540769:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554655744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869573.540776:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1788869573.540814:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf959c00 x1875765554655744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869573.540834:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554655744:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788869574.552410:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869575.576473:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554655872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869575.576538:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869575.576645:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554656000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869575.576671:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869575.576707:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554655872 00000100:00100000:1.0:1788869575.576715:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554655872 00000100:00100000:1.0:1788869575.576755:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554656000 00000100:00100000:1.0:1788869575.576772:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554656000 00000100:00100000:1.0:1788869575.576788:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788869575.576795:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554655872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869575.576822:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00010000:3.0:1788869575.576912:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869575.579459:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554655872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2654us (2910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869575.579473:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788869575.579503:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788869575.579517:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554656000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869575.579541:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869575.579605:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554656000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (2932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869575.579626:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1788869575.579645:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788869575.579709:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffae6af100 x1875765554656000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869591 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869575.579740:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554656000:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788869575.582504:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839cfb80 x1875765554655872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869591 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869575.582537:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554655872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869576.088538:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554656128:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869576.088609:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869576.088776:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554656128 00000100:00100000:0.0:1788869576.088785:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554656128 00000100:00100000:0.0:1788869576.088836:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788869576.088846:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554656128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869576.088892:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788869576.089378:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554656128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 532us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869576.089386:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788869576.089462:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554656128:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788869576.602067:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869577.752083:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869577.752495:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554656256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869577.752564:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869577.752717:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554656256 00000100:00100000:2.0:1788869577.752726:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554656256 00000100:00100000:2.0:1788869577.752783:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788869577.752791:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554656256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869577.752823:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788869577.754363:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554656256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1568us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869577.754479:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788869577.755668:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554656256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869577.831208:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869577.831272:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869577.831299:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869577.831326:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545150208 00000100:00100000:3.0:1788869577.831334:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545150208 00000100:00100000:3.0:1788869577.831384:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545150080 00000100:00100000:3.0:1788869577.831387:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545150080 00000100:00100000:3.0:1788869577.831407:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 99 00000100:00100000:3.0:1788869577.831415:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545150208:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869577.831483:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545150208:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 68us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869577.831491:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 99 00000100:00100000:3.0:1788869577.831507:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 100 00000100:00100000:3.0:1788869577.831512:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2387:x1875765545150080:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869577.831533:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2387:x1875765545150080:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869577.831538:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 100 00000100:00080000:3.0:1788869577.831551:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869577.831554:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869577.831898:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545149952 00000100:00100000:1.0:1788869577.831903:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545149952 00000100:00100000:1.0:1788869577.831934:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 280 00000100:00100000:1.0:1788869577.831951:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2387:x1875765545149952:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869577.831985:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2387:x1875765545149952:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 44us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869577.831991:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 280 00000100:00100000:2.0:1788869578.178050:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554656384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869578.178115:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869578.178787:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554656384 00000100:00100000:3.0:1788869578.178795:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554656384 00000100:00100000:3.0:1788869578.178850:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788869578.178859:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554656384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788869578.178893:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869578.178959:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554656384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869578.178966:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1788869578.179061:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83085180 x1875765554656384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869578.179078:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554656384:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788869578.183041:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869578.682142:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554656512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869578.682198:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869578.682276:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554656512 00000100:00100000:1.0:1788869578.682282:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554656512 00000100:00100000:1.0:1788869578.682323:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788869578.682330:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554656512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788869578.682356:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869578.682397:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554656512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869578.682404:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788869578.682424:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788869578.682453:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffae6af100 x1875765554656512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869578.682487:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554656512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869578.683723:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554656640:0@lo:400:kworker.0 00000100:00100000:1.0:1788869578.683765:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869578.683809:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554656640 00000100:00100000:0.0:1788869578.683816:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554656640 00000100:00100000:0.0:1788869578.683862:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788869578.683871:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554656640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869578.683930:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554656640:12345-0@lo:400:kworker.0 Request processed in 49us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869578.683950:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788869578.683991:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554656640:0@lo:400:kworker.0 00000100:00100000:1.0:1788869578.684139:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554656896:0@lo:400:kworker.0 00000100:00100000:1.0:1788869578.684190:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869578.684221:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869578.684228:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554656768:0@lo:400:kworker.0 00000100:00100000:1.0:1788869578.684285:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869578.684326:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554656768 00000100:00100000:1.0:1788869578.684330:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554656768 00000100:00100000:1.0:1788869578.684359:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788869578.684365:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554656768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869578.684401:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554656768:12345-0@lo:400:kworker.0 Request processed in 36us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869578.684408:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788869578.684435:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554656768:0@lo:400:kworker.0 00000100:00100000:0.0:1788869578.687132:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554656896 00000100:00100000:0.0:1788869578.687144:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554656896 00000100:00100000:0.0:1788869578.687205:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788869578.687215:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554656896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869578.687329:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554656896:12345-0@lo:400:kworker.0 Request processed in 116us (3138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869578.687337:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788869578.687436:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554656896:0@lo:400:kworker.0 00000100:00100000:1.0:1788869578.690829:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554657024:0@lo:400:kworker.0 00000100:00100000:1.0:1788869578.690905:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869578.690998:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554657024 00000100:00100000:2.0:1788869578.691007:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554657024 00000100:00100000:2.0:1788869578.691075:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788869578.691085:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554657024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869578.694567:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554657024:12345-0@lo:400:kworker.0 Request processed in 3475us (3653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869578.694579:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788869578.694633:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554657152:0@lo:400:kworker.0 00000100:00100000:2.0:1788869578.694691:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869578.694776:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554657152 00000100:00100000:0.0:1788869578.694782:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554657152 00000100:00100000:0.0:1788869578.694822:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788869578.694828:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554657152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869578.694870:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554657152:12345-0@lo:400:kworker.0 Request processed in 42us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869578.694873:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788869578.694964:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554657152:0@lo:400:kworker.0 00000100:00100000:2.0:1788869578.697344:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554657280:0@lo:400:kworker.0 00000100:00100000:2.0:1788869578.697394:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869578.697420:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554657792:0@lo:400:kworker.0 00000100:00100000:2.0:1788869578.697433:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869578.697449:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788869578.697452:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554657408:0@lo:400:kworker.0 00000100:00100000:2.0:1788869578.697464:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869578.697472:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf900700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875765554657920:0@lo:400:kworker.0 00000100:00100000:2.0:1788869578.697483:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869578.697501:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554657280 00000100:00100000:2.0:1788869578.697505:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554657280 00000100:00100000:2.0:1788869578.697535:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554657792 00000100:00100000:2.0:1788869578.697536:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554657792 00000100:00100000:2.0:1788869578.697544:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554657408 00000100:00100000:2.0:1788869578.697545:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554657408 00000100:00100000:2.0:1788869578.697554:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554657920 00000100:00100000:2.0:1788869578.697555:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554657920 00000100:00100000:2.0:1788869578.697563:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788869578.697568:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554657280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869578.697602:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554657280:12345-0@lo:400:kworker.0 Request processed in 33us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869578.697606:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788869578.697615:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788869578.697618:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554657792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869578.697632:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554657792:12345-0@lo:400:kworker.0 Request processed in 14us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869578.697649:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788869578.697658:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788869578.697661:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554657408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869578.697690:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554657408:12345-0@lo:400:kworker.0 Request processed in 28us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869578.697693:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788869578.697700:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788869578.697703:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875765554657920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869578.697717:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875765554657920:12345-0@lo:400:kworker.0 Request processed in 14us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869578.697721:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1788869578.697731:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869578.697734:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788869578.697750:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839cdf80 x1875765554657408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869578.697759:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554657408:0@lo:400:kworker.0 00010000:00080000:2.0:1788869578.697765:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf900700 x1875765554657920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869578.697771:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf900700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875765554657920:0@lo:400:kworker.0 00000100:00100000:2.0:1788869578.697780:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554657280:0@lo:400:kworker.0 00000100:00100000:2.0:1788869578.697788:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554657792:0@lo:400:kworker.0 00000100:00100000:2.0:1788869578.697813:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554657664:0@lo:400:kworker.0 00000100:00100000:2.0:1788869578.697840:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869578.697867:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869578.697871:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554657536:0@lo:400:kworker.0 00000100:00100000:2.0:1788869578.697887:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869578.697905:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554657664 00000100:00100000:2.0:1788869578.697907:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554657664 00000100:00100000:2.0:1788869578.697928:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554657536 00000100:00100000:2.0:1788869578.697940:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554657536 00000100:00100000:2.0:1788869578.697961:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788869578.697967:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554657664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869578.697999:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554657664:12345-0@lo:400:kworker.0 Request processed in 33us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869578.698004:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788869578.698013:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788869578.698016:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554657536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869578.698033:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554657536:12345-0@lo:400:kworker.0 Request processed in 18us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869578.698037:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1788869578.698049:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788869578.698061:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839cd880 x1875765554657536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869578.698067:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554657536:0@lo:400:kworker.0 00010000:00080000:2.0:1788869578.698072:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839cd180 x1875765554657664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869578.698076:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554657664:0@lo:400:kworker.0 00000100:00100000:1.0:1788869578.702514:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554657024:0@lo:400:kworker.0 00010000:00010000:3.0:1788869578.776429:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869579.803487:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869580.698093:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554658048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869580.698187:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869580.698290:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869580.698299:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554658176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869580.698326:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869580.698370:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554658048 00000100:00100000:2.0:1788869580.698379:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554658048 00000100:00100000:2.0:1788869580.698431:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554658176 00000100:00100000:2.0:1788869580.698434:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554658176 00000100:00100000:2.0:1788869580.698469:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788869580.698479:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554658048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869580.698517:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869580.698567:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554658048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869580.698575:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788869580.698595:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788869580.698601:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554658176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788869580.698612:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869580.698633:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554658176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869580.698639:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1788869580.698656:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788869580.699854:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82229f80 x1875765554658176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869596 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869580.699882:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554658176:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788869580.699896:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8222a300 x1875765554658048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869596 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869580.699908:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554658048:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788869580.824428:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869581.208858:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869581.208902:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554658304:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869581.209857:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869581.210037:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554658304 00000100:00100000:2.0:1788869581.210047:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554658304 00000100:00100000:2.0:1788869581.210111:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788869581.210123:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554658304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869581.210298:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869581.210390:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554658304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 266us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869581.210401:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788869581.210729:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf95a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554658304:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788869581.850573:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869582.882782:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869582.951883:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869582.951936:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869582.951959:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869582.951986:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545150336 00000100:00100000:3.0:1788869582.951994:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545150336 00000100:00100000:3.0:1788869582.952040:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 282 00000100:00100000:3.0:1788869582.952048:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2387:x1875765545150336:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869582.952109:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2387:x1875765545150336:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 62us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869582.952127:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 282 00000100:00100000:3.0:1788869582.952158:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545150464 00000100:00100000:3.0:1788869582.952162:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545150464 00000100:00100000:3.0:1788869582.952192:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545150592 00000100:00100000:3.0:1788869582.952194:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545150592 00000100:00100000:3.0:1788869582.952213:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 107 00000100:00100000:3.0:1788869582.952219:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+6:2387:x1875765545150464:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869582.952246:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+6:2387:x1875765545150464:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869582.952279:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 107 00000100:00100000:3.0:1788869582.952290:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 108 00000100:00100000:3.0:1788869582.952296:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545150592:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869582.952316:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545150592:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 20us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869582.952321:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 108 00000100:00080000:3.0:1788869582.952431:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869582.952435:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869583.256492:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554658432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869583.256569:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869583.256661:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554658432 00000100:00100000:3.0:1788869583.256669:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554658432 00000100:00100000:3.0:1788869583.256730:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788869583.256738:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554658432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869583.256767:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788869583.257042:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869583.257053:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554658560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869583.257082:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869583.257106:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554658560 00000100:00100000:2.0:1788869583.257110:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554658560 00000100:00100000:2.0:1788869583.257142:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788869583.257148:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554658560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869583.257166:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869583.257207:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554658560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869583.257212:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788869583.257229:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788869583.257270:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839cdf80 x1875765554658560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869583.257287:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554658560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869583.257907:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554658432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1168us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869583.257914:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788869583.258036:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554658432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869583.770184:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf902a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875765554658944:0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.770249:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869583.770308:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554659456:0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.770332:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869583.770349:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554659968:0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.770376:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869583.770401:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788869583.770407:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554658816:0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.770426:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869583.770441:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf900700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554659328:0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.770457:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869583.770471:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554659840:0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.770487:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869583.771424:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554658944 00000100:00100000:0.0:1788869583.771433:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554658944 00000100:00100000:0.0:1788869583.771467:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554658816 00000100:00100000:0.0:1788869583.771470:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554658816 00000100:00100000:0.0:1788869583.771480:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554659328 00000100:00100000:0.0:1788869583.771482:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554659328 00000100:00100000:0.0:1788869583.771503:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554659840 00000100:00100000:0.0:1788869583.771512:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554659840 00000100:00100000:0.0:1788869583.771531:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788869583.771539:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf95a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875765554658944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.771596:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf95a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875765554658944:12345-0@lo:400:kworker.0 Request processed in 57us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869583.771602:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788869583.771617:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788869583.771622:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554658816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.771645:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554658816:12345-0@lo:400:kworker.0 Request processed in 23us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869583.771650:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788869583.771660:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788869583.771665:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875765554659328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.771687:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875765554659328:12345-0@lo:400:kworker.0 Request processed in 22us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869583.771692:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788869583.771702:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788869583.771707:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875765554659840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.771727:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875765554659840:12345-0@lo:400:kworker.0 Request processed in 21us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869583.771732:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788869583.771747:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554659456 00000100:00100000:0.0:1788869583.771749:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554659456 00000100:00100000:0.0:1788869583.771769:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554659968 00000100:00100000:0.0:1788869583.771771:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554659968 00000100:00100000:0.0:1788869583.771787:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788869583.771793:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554659456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.771829:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554659456:12345-0@lo:400:kworker.0 Request processed in 37us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869583.771835:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788869583.771845:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788869583.771850:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554659968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.771872:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554659968:12345-0@lo:400:kworker.0 Request processed in 22us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869583.771876:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1788869583.772728:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869583.772733:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788869583.772735:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869583.772766:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554658816:0@lo:400:kworker.0 00010000:00080000:0.0:1788869583.772780:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf900700 x1875765554659328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869583.772790:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf900700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554659328:0@lo:400:kworker.0 00010000:00080000:0.0:1788869583.772800:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf982a00 x1875765554659840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869583.772808:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554659840:0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.772819:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf902a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875765554658944:0@lo:400:kworker.0 00010000:00080000:0.0:1788869583.772829:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf980e00 x1875765554659456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869583.772837:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554659456:0@lo:400:kworker.0 00010000:00080000:0.0:1788869583.772846:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf980000 x1875765554659968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869583.772859:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554659968:0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.773307:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf900380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554659072:0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.773349:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869583.773372:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554659584:0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.773390:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869583.773406:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788869583.773413:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554658688:0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.773436:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869583.773461:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875765554659200:0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.773480:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869583.773494:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875765554659712:0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.773510:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869583.773531:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554659584 00000100:00100000:0.0:1788869583.773535:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554659584 00000100:00100000:0.0:1788869583.773567:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788869583.773574:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554659584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.773610:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554659584:12345-0@lo:400:kworker.0 Request processed in 37us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869583.773616:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788869583.773632:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554659200 00000100:00100000:0.0:1788869583.773635:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554659200 00000100:00100000:0.0:1788869583.773652:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554659712 00000100:00100000:0.0:1788869583.773655:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554659712 00000100:00100000:0.0:1788869583.773669:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788869583.773674:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875765554659200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.773709:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875765554659200:12345-0@lo:400:kworker.0 Request processed in 35us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869583.773715:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788869583.773725:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788869583.773730:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875765554659712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.773749:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875765554659712:12345-0@lo:400:kworker.0 Request processed in 19us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869583.773755:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1788869583.773768:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869583.773770:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869583.773787:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875765554659200:0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.773796:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875765554659712:0@lo:400:kworker.0 00010000:00080000:0.0:1788869583.773805:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf982680 x1875765554659584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869583.773813:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554659584:0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.775011:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554658688 00000100:00100000:0.0:1788869583.775017:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554658688 00000100:00100000:0.0:1788869583.775055:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788869583.775061:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3616:x1875765554658688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869583.775119:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3616:x1875765554658688:12345-0@lo:400:kworker.0 Request processed in 58us (1682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869583.775125:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788869583.775162:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554658688:0@lo:400:kworker.0 00000100:00100000:3.0:1788869583.785317:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554659072 00000100:00100000:3.0:1788869583.785329:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554659072 00000100:00100000:3.0:1788869583.785379:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788869583.785388:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554659072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869583.785476:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554659072:12345-0@lo:400:kworker.0 Request processed in 88us (12126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869583.785483:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788869583.785804:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf900380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554659072:0@lo:400:kworker.0 00000100:00100000:1.0:1788869583.792381:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869583.792402:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554660096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869583.792464:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869583.792506:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554660096 00000100:00100000:1.0:1788869583.792512:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554660096 00000100:00100000:1.0:1788869583.792554:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788869583.792562:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554660096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788869583.792584:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869583.792621:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554660096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869583.792628:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788869583.792662:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82229f80 x1875765554660096/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869583.792679:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554660096:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788869583.896849:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869584.920630:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869585.816424:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869585.816448:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554660224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869585.816512:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869585.816572:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869585.816581:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554660352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869585.816606:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869585.816635:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554660224 00000100:00100000:1.0:1788869585.816642:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554660224 00000100:00100000:1.0:1788869585.816686:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554660352 00000100:00100000:1.0:1788869585.816689:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554660352 00000100:00100000:1.0:1788869585.816707:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788869585.816715:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554660224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869585.816757:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869585.816815:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554660224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869585.816822:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788869585.816838:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788869585.816844:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554660352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869585.816854:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869585.816892:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554660352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869585.816897:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788869585.816913:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869585.816940:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839bad80 x1875765554660352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869601 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869585.816957:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554660352:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788869585.816986:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf980700 x1875765554660224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869601 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869585.816997:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554660224:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788869585.948761:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869586.329555:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869586.329577:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554660480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869586.329650:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869586.329721:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554660480 00000100:00100000:0.0:1788869586.329728:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554660480 00000100:00100000:1.0:1788869586.330010:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788869586.330023:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554660480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788869586.330059:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788869586.330129:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554660480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869586.330136:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788869586.332673:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554660480:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788869586.968434:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869588.001506:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869588.111434:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869588.111515:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869588.111559:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869588.111585:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545150976 00000100:00100000:2.0:1788869588.111595:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545150976 00000100:00100000:3.0:1788869588.118659:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545150720 00000100:00100000:3.0:1788869588.118887:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545150720 00000100:00100000:3.0:1788869588.119859:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 284 00000100:00100000:3.0:1788869588.119873:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2387:x1875765545150720:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869588.119959:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2387:x1875765545150720:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 89us (8534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869588.119966:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 284 00000100:00080000:1.0:1788869588.122780:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869588.128673:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545150848 00000100:00100000:2.0:1788869588.128689:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545150848 00000100:00100000:2.0:1788869588.128737:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 115 00000100:00100000:2.0:1788869588.128747:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545150976:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869588.128833:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545150976:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 87us (17317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869588.128867:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 115 00000100:00100000:2.0:1788869588.128884:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 116 00000100:00100000:2.0:1788869588.128890:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+6:2387:x1875765545150848:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869588.128918:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+6:2387:x1875765545150848:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (17359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869588.128923:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 116 00000100:00080000:2.0:1788869588.128949:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869588.376460:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869588.376486:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554660608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869588.376554:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869588.376668:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554660608 00000100:00100000:1.0:1788869588.376676:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554660608 00000100:00100000:1.0:1788869588.376730:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788869588.376739:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554660608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869588.376795:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788869588.376857:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554660608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869588.376864:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788869588.376906:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554660608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869588.377192:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869588.377205:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554660736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869588.377240:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869588.377353:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554660736 00000100:00100000:0.0:1788869588.377358:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554660736 00000100:00100000:0.0:1788869588.377398:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788869588.377405:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554660736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869588.377423:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869588.377456:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554660736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869588.377462:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788869588.377478:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788869588.377499:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffb9b51f80 x1875765554660736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869588.377513:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554660736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869588.888449:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554661120:0@lo:400:kworker.0 00000100:00100000:3.0:1788869588.888518:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869588.888572:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554661632:0@lo:400:kworker.0 00000100:00100000:3.0:1788869588.888598:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869588.888617:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554662144:0@lo:400:kworker.0 00000100:00100000:3.0:1788869588.888638:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869588.888664:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788869588.888669:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554661248:0@lo:400:kworker.0 00000100:00100000:3.0:1788869588.888703:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869588.888723:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554661760:0@lo:400:kworker.0 00000100:00100000:3.0:1788869588.888891:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869588.888931:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554661120 00000100:00100000:3.0:1788869588.888939:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554661120 00000100:00100000:3.0:1788869588.888983:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788869588.888992:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554661120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869588.889065:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554661120:12345-0@lo:400:kworker.0 Request processed in 57us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869588.889072:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788869588.889095:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554661632 00000100:00100000:3.0:1788869588.889099:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554661632 00000100:00100000:3.0:1788869588.889129:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554662144 00000100:00100000:3.0:1788869588.889132:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554662144 00000100:00100000:3.0:1788869588.889147:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554661760 00000100:00100000:3.0:1788869588.889149:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554661760 00000100:00100000:3.0:1788869588.889163:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788869588.889169:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554661632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869588.889200:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554661632:12345-0@lo:400:kworker.0 Request processed in 31us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869588.889206:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788869588.889218:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788869588.889224:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554662144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869588.889249:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554662144:12345-0@lo:400:kworker.0 Request processed in 26us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869588.889276:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788869588.889287:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788869588.889301:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554661760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869588.889332:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554661760:12345-0@lo:400:kworker.0 Request processed in 32us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869588.889338:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788869588.889359:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554661248 00000100:00100000:3.0:1788869588.889363:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554661248 00000100:00100000:3.0:1788869588.889386:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788869588.889391:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554661248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869588.889421:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554661248:12345-0@lo:400:kworker.0 Request processed in 29us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869588.889427:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1788869588.889537:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869588.889541:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869588.889573:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554661248:0@lo:400:kworker.0 00010000:00080000:3.0:1788869588.889587:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf983800 x1875765554661760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869588.889597:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554661760:0@lo:400:kworker.0 00000100:00100000:3.0:1788869588.889607:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554661120:0@lo:400:kworker.0 00010000:00080000:3.0:1788869588.889616:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf983b80 x1875765554661632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869588.889624:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554661632:0@lo:400:kworker.0 00010000:00080000:3.0:1788869588.889634:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf982d80 x1875765554662144/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869588.889640:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554662144:0@lo:400:kworker.0 00000100:00100000:1.0:1788869588.889967:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554660864:0@lo:400:kworker.0 00000100:00100000:1.0:1788869588.890006:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869588.890032:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554661376:0@lo:400:kworker.0 00000100:00100000:1.0:1788869588.890051:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869588.890066:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554661888:0@lo:400:kworker.0 00000100:00100000:1.0:1788869588.890083:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869588.890099:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788869588.890105:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554660992:0@lo:400:kworker.0 00000100:00100000:1.0:1788869588.890125:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869588.890141:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554661504:0@lo:400:kworker.0 00000100:00100000:1.0:1788869588.890158:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869588.890172:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875765554662016:0@lo:400:kworker.0 00000100:00100000:1.0:1788869588.890191:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869588.890214:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554660864 00000100:00100000:1.0:1788869588.890219:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554660864 00000100:00100000:1.0:1788869588.890270:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788869588.890278:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554660864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869588.890316:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554660864:12345-0@lo:400:kworker.0 Request processed in 40us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869588.890322:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788869588.890349:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554661376 00000100:00100000:1.0:1788869588.890353:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554661376 00000100:00100000:1.0:1788869588.890377:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554661888 00000100:00100000:1.0:1788869588.890380:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554661888 00000100:00100000:1.0:1788869588.890391:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554660992 00000100:00100000:1.0:1788869588.890394:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554660992 00000100:00100000:1.0:1788869588.890402:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554661504 00000100:00100000:1.0:1788869588.890404:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554661504 00000100:00100000:1.0:1788869588.890414:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554662016 00000100:00100000:1.0:1788869588.890417:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554662016 00000100:00100000:1.0:1788869588.890429:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788869588.890434:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554661376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869588.890463:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554661376:12345-0@lo:400:kworker.0 Request processed in 29us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869588.890469:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788869588.890480:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788869588.890486:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554661888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869588.890527:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554661888:12345-0@lo:400:kworker.0 Request processed in 40us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869588.890534:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788869588.890547:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788869588.890552:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554660992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869588.890575:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554660992:12345-0@lo:400:kworker.0 Request processed in 24us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869588.890587:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788869588.890598:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788869588.890603:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554661504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869588.890631:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554661504:12345-0@lo:400:kworker.0 Request processed in 28us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869588.890636:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788869588.890645:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788869588.890651:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875765554662016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869588.890673:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875765554662016:12345-0@lo:400:kworker.0 Request processed in 22us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869588.890678:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1788869588.890697:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869588.890700:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869588.890719:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554660992:0@lo:400:kworker.0 00010000:00080000:1.0:1788869588.890729:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf980380 x1875765554661504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869588.890738:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554661504:0@lo:400:kworker.0 00010000:00080000:1.0:1788869588.890745:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf981880 x1875765554662016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869588.890752:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875765554662016:0@lo:400:kworker.0 00000100:00100000:1.0:1788869588.890759:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554660864:0@lo:400:kworker.0 00000100:00100000:1.0:1788869588.890767:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554661376:0@lo:400:kworker.0 00000100:00100000:1.0:1788869588.890775:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554661888:0@lo:400:kworker.0 00000100:00100000:2.0:1788869588.892278:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869588.901168:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554662272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869588.901245:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869588.901381:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554662272 00000100:00100000:0.0:1788869588.901389:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554662272 00000100:00100000:0.0:1788869588.901441:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788869588.901449:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554662272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869588.901473:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869588.901513:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554662272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869588.901527:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1788869588.901594:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf982d80 x1875765554662272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869588.901612:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554662272:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788869589.016650:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869590.042673:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869590.937496:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554662400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869590.937569:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869590.937627:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869590.937634:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554662528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869590.937658:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869590.937732:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554662400 00000100:00100000:1.0:1788869590.937741:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554662400 00000100:00100000:1.0:1788869590.937792:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554662528 00000100:00100000:1.0:1788869590.937795:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554662528 00000100:00100000:1.0:1788869590.937826:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788869590.937835:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554662400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869590.937861:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869590.937904:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554662400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869590.937912:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788869590.937928:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788869590.937934:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554662528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869590.937942:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869590.937965:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554662528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 32us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869590.937971:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1788869590.938375:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788869590.938404:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf983b80 x1875765554662528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869606 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869590.938436:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554662528:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788869590.938449:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82324e00 x1875765554662400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869606 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869590.938460:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554662400:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788869591.064882:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869591.452816:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554662656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869591.452891:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869591.453433:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554662656 00000100:00100000:0.0:1788869591.453442:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554662656 00000100:00100000:0.0:1788869591.453506:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788869591.453516:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554662656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869591.453555:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788869591.453621:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554662656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869591.453629:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788869591.453827:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554662656:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788869592.092977:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869593.112448:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869593.191578:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869593.191628:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869593.191672:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869593.191706:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545151360 00000100:00100000:1.0:1788869593.191720:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545151360 00000100:00100000:0.0:1788869593.191767:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545151232 00000100:00100000:0.0:1788869593.191774:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545151232 00000100:00100000:3.0:1788869593.191842:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545151104 00000100:00100000:3.0:1788869593.191847:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545151104 00000100:00100000:1.0:1788869593.191853:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 123 00000100:00100000:1.0:1788869593.191865:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545151360:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869593.191895:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 286 00000100:00100000:3.0:1788869593.191905:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2390:x1875765545151104:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869593.191952:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545151360:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 83us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869593.191961:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 123 00000100:00080000:2.0:1788869593.194587:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869593.194596:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869593.197005:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 124 00000100:00100000:0.0:1788869593.197023:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:2390:x1875765545151232:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869593.197411:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2390:x1875765545151104:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 5505us (5840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869593.197422:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 286 00000100:00100000:0.0:1788869593.208643:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:2390:x1875765545151232:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 11613us (16957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869593.208659:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 124 00000100:00100000:2.0:1788869593.496553:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869593.496577:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554662784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869593.496646:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869593.496913:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554662784 00000100:00100000:0.0:1788869593.496922:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554662784 00000100:00100000:0.0:1788869593.496989:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788869593.497001:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554662784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869593.497032:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869593.497076:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554662784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869593.497083:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788869593.497153:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788869593.497187:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffb9b50e00 x1875765554662784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869593.497205:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554662784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869593.497622:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869593.497639:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554662912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869593.497703:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869593.497975:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554662912 00000100:00100000:1.0:1788869593.497988:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554662912 00000100:00100000:1.0:1788869593.498071:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788869593.498083:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554662912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869593.498115:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788869593.498184:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554662912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869593.498197:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788869593.498231:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554662912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869594.013448:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869594.013472:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554663040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869594.013540:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869594.013616:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554663040 00000100:00100000:3.0:1788869594.013623:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554663040 00000100:00100000:3.0:1788869594.013673:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788869594.013682:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554663040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869594.013703:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869594.013747:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554663040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869594.013755:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1788869594.013775:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788869594.013814:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf981c00 x1875765554663040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869610 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869594.013835:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554663040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869594.014700:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875765554663296:0@lo:400:kworker.0 00000100:00100000:1.0:1788869594.014739:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869594.014769:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554663808:0@lo:400:kworker.0 00000100:00100000:1.0:1788869594.014801:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869594.014819:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554664320:0@lo:400:kworker.0 00000100:00100000:1.0:1788869594.014842:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869594.014860:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788869594.014866:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554663168:0@lo:400:kworker.0 00000100:00100000:1.0:1788869594.014894:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869594.014920:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875765554663680:0@lo:400:kworker.0 00000100:00100000:1.0:1788869594.014940:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869594.014957:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1875765554664192:0@lo:400:kworker.0 00000100:00100000:1.0:1788869594.014977:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869594.014999:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554663296 00000100:00100000:1.0:1788869594.015004:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554663296 00000100:00100000:1.0:1788869594.015029:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554663808 00000100:00100000:1.0:1788869594.015031:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554663808 00000100:00100000:1.0:1788869594.015087:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554664320 00000100:00100000:1.0:1788869594.015091:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554664320 00000100:00100000:1.0:1788869594.015101:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554663680 00000100:00100000:1.0:1788869594.015103:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554663680 00000100:00100000:1.0:1788869594.015113:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554664192 00000100:00100000:1.0:1788869594.015116:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554664192 00000100:00100000:1.0:1788869594.015127:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788869594.015133:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875765554663296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869594.015176:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875765554663296:12345-0@lo:400:kworker.0 Request processed in 42us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869594.015183:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788869594.015196:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788869594.015203:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554663808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869594.015230:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554663808:12345-0@lo:400:kworker.0 Request processed in 29us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869594.015235:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788869594.015245:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788869594.015250:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875765554664320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869594.015303:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875765554664320:12345-0@lo:400:kworker.0 Request processed in 53us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869594.015310:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788869594.015322:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788869594.015327:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875765554663680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869594.015352:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875765554663680:12345-0@lo:400:kworker.0 Request processed in 25us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869594.015357:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788869594.015368:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788869594.015381:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875765554664192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869594.015408:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875765554664192:12345-0@lo:400:kworker.0 Request processed in 28us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869594.015413:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788869594.015432:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554663168 00000100:00100000:1.0:1788869594.015434:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554663168 00000100:00100000:1.0:1788869594.015454:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788869594.015459:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554663168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869594.015484:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554663168:12345-0@lo:400:kworker.0 Request processed in 24us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869594.015489:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788869594.015516:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554663552:0@lo:400:kworker.0 00000100:00100000:1.0:1788869594.015537:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869594.015551:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf900380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554664064:0@lo:400:kworker.0 00000100:00100000:1.0:1788869594.015567:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869594.015593:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788869594.015599:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875765554663424:0@lo:400:kworker.0 00000100:00100000:1.0:1788869594.015617:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869594.015632:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554663936:0@lo:400:kworker.0 00000100:00100000:1.0:1788869594.015651:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869594.015681:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554663168:0@lo:400:kworker.0 00000100:00100000:1.0:1788869594.015692:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875765554663680:0@lo:400:kworker.0 00000100:00100000:1.0:1788869594.015700:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1875765554664192:0@lo:400:kworker.0 00000100:00100000:1.0:1788869594.015708:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875765554663296:0@lo:400:kworker.0 00010000:00080000:1.0:1788869594.015728:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffb9b50e00 x1875765554663808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869594.015737:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554663808:0@lo:400:kworker.0 00010000:00080000:1.0:1788869594.015747:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf901f80 x1875765554664320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869594.015755:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554664320:0@lo:400:kworker.0 00000100:00100000:1.0:1788869594.015792:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554663424 00000100:00100000:1.0:1788869594.015796:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554663424 00000100:00100000:1.0:1788869594.015817:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788869594.015823:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875765554663424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869594.015857:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875765554663424:12345-0@lo:400:kworker.0 Request processed in 34us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869594.015863:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788869594.015886:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875765554663424:0@lo:400:kworker.0 00000100:00100000:3.0:1788869594.017724:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554663552 00000100:00100000:3.0:1788869594.017749:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554663552 00000100:00100000:3.0:1788869594.017814:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788869594.017822:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554663552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869594.017904:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554663552:12345-0@lo:400:kworker.0 Request processed in 83us (2366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869594.017910:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788869594.017933:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554664064 00000100:00100000:3.0:1788869594.017935:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554664064 00000100:00100000:3.0:1788869594.017959:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554663936 00000100:00100000:3.0:1788869594.017962:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554663936 00000100:00100000:3.0:1788869594.017979:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788869594.017985:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554664064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869594.018018:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554664064:12345-0@lo:400:kworker.0 Request processed in 33us (2449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869594.018023:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788869594.018033:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788869594.018052:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554663936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869594.018092:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554663936:12345-0@lo:400:kworker.0 Request processed in 53us (2439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869594.018097:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788869594.018122:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869594.018127:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869594.018129:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788869594.018343:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffb9b51f80 x1875765554663936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869594.018358:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554663936:0@lo:400:kworker.0 00000100:00100000:0.0:1788869594.018370:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554663552:0@lo:400:kworker.0 00010000:00080000:0.0:1788869594.018379:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf900380 x1875765554664064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869594.018386:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf900380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554664064:0@lo:400:kworker.0 00010000:00010000:3.0:1788869594.137034:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788869594.824971:0:11960:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:13:13 (1788869593) === 00010000:00010000:1.0:1788869595.160470:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869595.344230:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869595.344433:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545151488 00000100:00100000:3.0:1788869595.344444:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545151488 00000100:00100000:3.0:1788869595.344499:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 288 00000100:00100000:3.0:1788869595.344509:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:8714:x1875765545151488:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788869595.344538:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869595.344556:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb9a9ec00/0xbead52e175fc2cf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa920 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869595.344596:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb9a9ec00/0xbead52e175fc2cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa920 expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869595.344608:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb9a9ec00/0xbead52e175fc2cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa920 expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869595.344617:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9ec00, rc 0) 00000100:00100000:3.0:1788869595.344701:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+11:8714:x1875765545151488:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 191us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869595.344708:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 288 00000100:00100000:0.0:1788869595.361702:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869595.361871:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545151616 00000100:00100000:1.0:1788869595.361884:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545151616 00000100:00100000:1.0:1788869595.361985:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 289 00000100:00100000:1.0:1788869595.362020:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+11:8714:x1875765545151616:12345-192.168.201.30@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788869595.362847:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+11:8714:x1875765545151616:12345-192.168.201.30@tcp:501:mount.lustre.0 Request processed in 850us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869595.362895:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 289 00000100:00100000:2.0:1788869595.367970:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869595.368140:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545151744 00000100:00100000:1.0:1788869595.368153:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545151744 00000100:00100000:1.0:1788869595.368232:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 290 00000100:00100000:1.0:1788869595.368279:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+11:8714:x1875765545151744:12345-192.168.201.30@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788869595.368508:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+11:8714:x1875765545151744:12345-192.168.201.30@tcp:503:mount.lustre.0 Request processed in 253us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869595.368517:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 290 00000100:00100000:2.0:1788869595.373616:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869595.374086:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545151872 00000100:00100000:1.0:1788869595.374099:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545151872 00000100:00100000:1.0:1788869595.374171:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 291 00000100:00100000:1.0:1788869595.374183:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88938450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+11:8718:x1875765545151872:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788869595.374518:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88938450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+11:8718:x1875765545151872:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 336us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869595.374528:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 291 00000100:00100000:0.0:1788869595.393332:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869595.393570:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545152000 00000100:00100000:3.0:1788869595.393581:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545152000 00000100:00100000:3.0:1788869595.393637:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 292 00000100:00100000:3.0:1788869595.393646:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88938c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+11:8718:x1875765545152000:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788869595.394830:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88938c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+11:8718:x1875765545152000:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 1180us (1505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869595.394842:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 292 00000100:00100000:3.0:1788869595.405004:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869595.405477:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545152128 00000100:00100000:2.0:1788869595.405490:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545152128 00000100:00100000:2.0:1788869595.405637:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 293 00000100:00100000:2.0:1788869595.405649:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+11:8718:x1875765545152128:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869595.405863:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+11:8718:x1875765545152128:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 215us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869595.405872:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 293 00000100:00100000:2.0:1788869595.408672:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869595.408833:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545152256 00000100:00100000:3.0:1788869595.408842:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545152256 00000100:00100000:3.0:1788869595.408937:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 294 00000100:00100000:3.0:1788869595.408948:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+11:8714:x1875765545152256:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788869595.408991:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869595.409017:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc2d00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa951 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869595.409053:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc2d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa951 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869595.409066:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc2d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa951 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869595.409077:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9e200, rc 0) 00000100:00100000:3.0:1788869595.409138:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:8714:x1875765545152256:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 192us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869595.409145:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 294 00000100:00100000:0.0:1788869595.411995:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869595.412089:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545152384 00000100:00100000:2.0:1788869595.412099:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545152384 00000100:00100000:2.0:1788869595.412154:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 295 00000100:00100000:2.0:1788869595.412165:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:8714:x1875765545152384:12345-192.168.201.30@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788869595.412191:0:6478:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788869595.412221:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788869595.412226:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788869595.412230:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788869595.412234:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788869595.412236:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788869595.414137:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:8714:x1875765545152384:12345-192.168.201.30@tcp:256:mount.lustre.0 Request processed in 1965us (2144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869595.414150:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 295 00000100:00100000:3.0:1788869595.420022:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869595.420194:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545152512 00000100:00100000:0.0:1788869595.420206:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545152512 00000100:00100000:0.0:1788869595.420303:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 296 00000100:00100000:0.0:1788869595.420315:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88938850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:8714:x1875765545152512:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788869595.420337:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869595.420359:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb98e3a00/0xbead52e175fc2d07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa958 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869595.420394:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb98e3a00/0xbead52e175fc2d07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa958 expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869595.420407:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb98e3a00/0xbead52e175fc2d07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa958 expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869595.420442:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb98e3a00, rc 0) 00000100:00100000:0.0:1788869595.420820:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88938850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:8714:x1875765545152512:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 506us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869595.420829:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 296 00000100:00100000:0.0:1788869595.431541:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869595.431915:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545152640 00000100:00100000:1.0:1788869595.431929:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545152640 00000100:00100000:1.0:1788869595.432007:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 297 00000100:00100000:1.0:1788869595.432021:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88939050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:8714:x1875765545152640:12345-192.168.201.30@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788869595.432231:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88939050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:8714:x1875765545152640:12345-192.168.201.30@tcp:501:mount.lustre.0 Request processed in 212us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869595.432240:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 297 00000100:00100000:3.0:1788869595.434191:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869595.435619:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545152768 00000100:00100000:0.0:1788869595.435634:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545152768 00000100:00100000:0.0:1788869595.435714:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 298 00000100:00100000:0.0:1788869595.435738:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88939c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:8714:x1875765545152768:12345-192.168.201.30@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788869595.436224:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88939c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:8714:x1875765545152768:12345-192.168.201.30@tcp:503:mount.lustre.0 Request processed in 498us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869595.436235:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 298 00000100:00100000:0.0:1788869595.442904:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869595.445874:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545152896 00000100:00100000:3.0:1788869595.445895:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545152896 00000100:00100000:3.0:1788869595.446067:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 299 00000100:00100000:3.0:1788869595.446081:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88939850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:8723:x1875765545152896:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788869595.446326:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88939850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:8723:x1875765545152896:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 248us (3435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869595.446336:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 299 00000100:00100000:0.0:1788869595.464210:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869595.472740:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545153024 00000100:00100000:3.0:1788869595.472836:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545153024 00000100:00100000:0.0:1788869595.481056:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 300 00000100:00100000:0.0:1788869595.481080:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88939450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:8723:x1875765545153024:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788869595.483284:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88939450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:8723:x1875765545153024:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 2199us (19076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869595.483298:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 300 00000100:00100000:0.0:1788869595.497876:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869595.497921:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869595.497963:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869595.497991:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869595.498037:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545153792 00000100:00100000:0.0:1788869595.498068:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545153792 00000100:00100000:0.0:1788869595.498138:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545153920 00000100:00100000:0.0:1788869595.498142:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545153920 00000100:00100000:0.0:1788869595.498159:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545153152 00000100:00100000:0.0:1788869595.498161:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545153152 00000100:00100000:0.0:1788869595.498171:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545153408 00000100:00100000:0.0:1788869595.498173:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545153408 00000100:00100000:0.0:1788869595.498188:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 131 00000100:00100000:0.0:1788869595.498199:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2388:x1875765545153792:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869595.498332:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2388:x1875765545153792:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 134us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869595.498341:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 131 00000100:00100000:0.0:1788869595.498362:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 132 00000100:00100000:0.0:1788869595.498369:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2388:x1875765545153920:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869595.498396:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2388:x1875765545153920:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869595.498402:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 132 00000100:00100000:0.0:1788869595.498415:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:0.0:1788869595.498420:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2386:x1875765545153152:12345-192.168.201.30@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788869595.498446:0:6485:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 85067cd6-7cd1-4166-bc53-2e9768411f07@192.168.201.30@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:0.0:1788869595.498528:0:6485:0:(genops.c:1406:class_connect()) connect: client 85067cd6-7cd1-4166-bc53-2e9768411f07, cookie 0xbead52e175fc2d0e 00000004:00100000:0.0:1788869595.498563:0:6485:0:(mdt_handler.c:7362:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788869595.498737:0:6485:0:(import.c:65:import_set_state_nolock()) ffff99fe833d9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869595.498786:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+6:2386:x1875765545153152:12345-192.168.201.30@tcp:38:mount.lustre.0 Request processed in 364us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869595.498793:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:0.0:1788869595.498816:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:0.0:1788869595.498821:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2386:x1875765545153408:12345-192.168.201.30@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788869595.498836:0:6485:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 85067cd6-7cd1-4166-bc53-2e9768411f07@192.168.201.30@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:0.0:1788869595.498879:0:6485:0:(genops.c:1406:class_connect()) connect: client 85067cd6-7cd1-4166-bc53-2e9768411f07, cookie 0xbead52e175fc2d15 00000004:00100000:0.0:1788869595.498893:0:6485:0:(mdt_handler.c:7362:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788869595.498971:0:6485:0:(import.c:65:import_set_state_nolock()) ffff99fe833dc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869595.498997:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+6:2386:x1875765545153408:12345-192.168.201.30@tcp:38:mount.lustre.0 Request processed in 174us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869595.499004:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00080000:3.0:1788869595.499605:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869595.499612:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869595.530667:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869595.530720:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869595.530897:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545153536 00000100:00100000:2.0:1788869595.530910:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545153536 00000100:00080000:3.0:1788869595.531117:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869595.531203:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545153280 00000100:00100000:2.0:1788869595.531208:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545153280 00000100:00100000:2.0:1788869595.531275:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:2.0:1788869595.531287:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+6:0:x1875765545153536:12345-192.168.201.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788869595.531336:0:6486:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869595.531477:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+6:0:x1875765545153536:12345-192.168.201.30@tcp:41:mount.lustre.0 Request processed in 192us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869595.531486:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00080000:3.0:1788869595.531590:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869595.531620:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:3.0:1788869595.531630:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+6:0:x1875765545153280:12345-192.168.201.30@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788869595.531654:0:9496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788869595.531700:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+6:0:x1875765545153280:12345-192.168.201.30@tcp:41:mount.lustre.0 Request processed in 73us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869595.531707:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:1.0:1788869595.531860:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869595.532326:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545153664 00000100:00100000:2.0:1788869595.532338:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545153664 00000100:00100000:2.0:1788869595.532358:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:2.0:1788869595.532363:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+7:8714:x1875765545153664:12345-192.168.201.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788869595.532377:0:6486:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788869595.532406:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+7:8714:x1875765545153664:12345-192.168.201.30@tcp:41:mount.lustre.0 Request processed in 42us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869595.532412:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:2.0:1788869595.542693:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869595.543224:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545154048 00000100:00100000:0.0:1788869595.543237:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545154048 00000100:00100000:0.0:1788869595.543340:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:0.0:1788869595.543350:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+6:8714:x1875765545154048:12345-192.168.201.30@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788869595.543450:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+6:8714:x1875765545154048:12345-192.168.201.30@tcp:40:mount.lustre.0 Request processed in 101us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869595.543458:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:0.0:1788869595.547831:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869595.547923:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545154176 00000100:00100000:3.0:1788869595.547935:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545154176 00000100:00100000:3.0:1788869595.547989:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:3.0:1788869595.548053:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf901f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2386:x1875765545154176:12345-192.168.201.30@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788869595.548096:0:8399:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 85067cd6-7cd1-4166-bc53-2e9768411f07@192.168.201.30@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:3.0:1788869595.548134:0:8399:0:(genops.c:1406:class_connect()) connect: client 85067cd6-7cd1-4166-bc53-2e9768411f07, cookie 0xbead52e175fc2d1c 00002000:00100000:3.0:1788869595.548148:0:8399:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 85067cd6-7cd1-4166-bc53-2e9768411f07/ffff99fe81cb5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788869595.548171:0:8399:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788869595.548329:0:8399:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788869595.548367:0:8399:0:(import.c:65:import_set_state_nolock()) ffff99fe81cb2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869595.548456:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf901f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85067cd6-7cd1-4166-bc53-2e9768411f07+6:2386:x1875765545154176:12345-192.168.201.30@tcp:8:mount.lustre.0 Request processed in 456us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869595.548466:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:1.0:1788869595.556826:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869595.556913:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869595.558625:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545154432 00000100:00100000:0.0:1788869595.558641:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545154432 00000100:00100000:0.0:1788869595.558722:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:0.0:1788869595.558733:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:85067cd6-7cd1-4166-bc53-2e9768411f07+6:8714:x1875765545154432:12345-192.168.201.30@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788869595.559010:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:85067cd6-7cd1-4166-bc53-2e9768411f07+6:8714:x1875765545154432:12345-192.168.201.30@tcp:900:mount.lustre.0 Request processed in 277us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869595.559020:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:3.0:1788869595.562706:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545154304 00000100:00100000:3.0:1788869595.562724:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545154304 00000100:00100000:2.0:1788869595.563143:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:2.0:1788869595.563153:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2386:x1875765545154304:12345-192.168.201.30@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788869595.563196:0:8400:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 85067cd6-7cd1-4166-bc53-2e9768411f07@192.168.201.30@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:2.0:1788869595.563238:0:8400:0:(genops.c:1406:class_connect()) connect: client 85067cd6-7cd1-4166-bc53-2e9768411f07, cookie 0xbead52e175fc2d23 00002000:00100000:2.0:1788869595.563272:0:8400:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 85067cd6-7cd1-4166-bc53-2e9768411f07/ffff99ffb9b2e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788869595.563297:0:8400:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788869595.563397:0:8400:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788869595.563439:0:8400:0:(import.c:65:import_set_state_nolock()) ffff99ffb9b2c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869595.564204:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+6:2386:x1875765545154304:12345-192.168.201.30@tcp:8:mount.lustre.0 Request processed in 1048us (7388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869595.564214:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:0.0:1788869595.568152:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869595.570664:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545154560 00000100:00100000:3.0:1788869595.570682:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545154560 00000100:00100000:3.0:1788869595.570816:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:3.0:1788869595.570829:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85067cd6-7cd1-4166-bc53-2e9768411f07+6:8714:x1875765545154560:12345-192.168.201.30@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788869595.570962:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788869595.571229:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85067cd6-7cd1-4166-bc53-2e9768411f07+6:8714:x1875765545154560:12345-192.168.201.30@tcp:33:mount.lustre.0 Request processed in 402us (3087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869595.571238:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:0.0:1788869596.056892:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554664448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869596.057031:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869596.057249:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554664448 00000100:00100000:1.0:1788869596.057290:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554664448 00000100:00100000:1.0:1788869596.057357:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788869596.057367:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554664448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869596.057396:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869596.057447:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554664448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869596.057455:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788869596.057575:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788869596.057612:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839cb800 x1875765554664448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869596.057635:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554664448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869596.057899:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554664576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869596.057941:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869596.058090:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554664576 00000100:00100000:1.0:1788869596.058094:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554664576 00000100:00100000:1.0:1788869596.058145:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788869596.058153:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554664576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869596.058167:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869596.058198:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554664576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869596.058218:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1788869596.058363:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788869596.058418:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf981c00 x1875765554664576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869596.058432:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554664576:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788869596.184471:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869596.571879:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869596.571920:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554664704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869596.572061:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869596.572302:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554664704 00000100:00100000:0.0:1788869596.572313:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554664704 00000100:00100000:0.0:1788869596.572393:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788869596.572405:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554664704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869596.572455:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788869596.572514:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554664704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869596.572523:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788869596.572749:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554664704:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788869597.208494:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869598.242972:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869598.616555:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869598.616579:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554664832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869598.616657:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869598.616898:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554664832 00000100:00100000:0.0:1788869598.616907:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554664832 00000100:00100000:0.0:1788869598.616960:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788869598.616969:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff87cef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554664832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788869598.617001:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788869598.617049:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff87cef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554664832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869598.617057:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788869598.617331:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554664832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869598.622468:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554664960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869598.622549:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869598.622632:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554664960 00000100:00100000:3.0:1788869598.622640:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554664960 00000100:00100000:3.0:1788869598.622705:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788869598.622726:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554664960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788869598.622763:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788869598.624972:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869598.634663:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554664960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11940us (12104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869598.634684:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:1.0:1788869598.635382:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfa48000 x1875765554664960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869614 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869598.635409:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554664960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869599.129480:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554665088:0@lo:400:kworker.0 00000100:00100000:0.0:1788869599.129571:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869599.129646:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554665600:0@lo:400:kworker.0 00000100:00100000:2.0:1788869599.129773:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554665088 00000100:00100000:2.0:1788869599.129782:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554665088 00000100:00100000:0.0:1788869599.129811:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869599.129856:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788869599.129869:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88938050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3619:x1875765554665088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869599.129891:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554666112:0@lo:400:kworker.0 00000100:00100000:2.0:1788869599.129951:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88938050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3619:x1875765554665088:12345-0@lo:400:kworker.0 Request processed in 82us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869599.129960:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788869599.130171:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869599.130322:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554666624:0@lo:400:kworker.0 00000100:00100000:0.0:1788869599.130359:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869599.130421:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554665088:0@lo:400:kworker.0 00000100:00100000:0.0:1788869599.130444:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788869599.130451:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875765554665472:0@lo:400:kworker.0 00000100:00100000:0.0:1788869599.130480:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869599.130500:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554665984:0@lo:400:kworker.0 00000100:00100000:0.0:1788869599.130520:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869599.130536:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554666496:0@lo:400:kworker.0 00000100:00100000:0.0:1788869599.130554:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869599.130584:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554665216:0@lo:400:kworker.0 00000100:00100000:0.0:1788869599.130605:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869599.130618:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875765554665728:0@lo:400:kworker.0 00000100:00100000:0.0:1788869599.130634:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869599.130649:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875765554666240:0@lo:400:kworker.0 00000100:00100000:0.0:1788869599.130672:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869599.130690:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554666112 00000100:00100000:2.0:1788869599.130698:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554666112 00000100:00100000:0.0:1788869599.130699:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788869599.130710:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554665344:0@lo:400:kworker.0 00000100:00100000:2.0:1788869599.130755:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554666624 00000100:00100000:2.0:1788869599.130761:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554666624 00000100:00100000:2.0:1788869599.130775:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554665984 00000100:00100000:2.0:1788869599.130778:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554665984 00000100:00100000:2.0:1788869599.130791:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554666496 00000100:00100000:2.0:1788869599.130794:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554666496 00000100:00100000:2.0:1788869599.130811:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788869599.130819:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554666112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869599.130876:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554666112:12345-0@lo:400:kworker.0 Request processed in 57us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869599.130884:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788869599.130902:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788869599.130910:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554666624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869599.130922:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869599.130947:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554665856:0@lo:400:kworker.0 00000100:00100000:0.0:1788869599.130986:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869599.131005:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554666368:0@lo:400:kworker.0 00000100:00100000:0.0:1788869599.131046:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869599.131087:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788869599.131101:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554665984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869599.131154:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554665984:12345-0@lo:400:kworker.0 Request processed in 57us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869599.131163:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788869599.131191:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788869599.131199:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554666496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869599.131230:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554666624:12345-0@lo:400:kworker.0 Request processed in 319us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869599.131243:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788869599.131302:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554665472 00000100:00100000:2.0:1788869599.131306:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554665472 00000100:00100000:2.0:1788869599.131328:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554665216 00000100:00100000:2.0:1788869599.131331:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554665216 00000100:00100000:2.0:1788869599.131343:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554665728 00000100:00100000:2.0:1788869599.131345:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554665728 00000100:00100000:2.0:1788869599.131362:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554666240 00000100:00100000:2.0:1788869599.131365:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554666240 00000100:00100000:2.0:1788869599.131381:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554665856 00000100:00100000:2.0:1788869599.131383:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554665856 00000100:00100000:2.0:1788869599.131401:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554666368 00000100:00100000:2.0:1788869599.131404:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554666368 00000100:00100000:2.0:1788869599.131423:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788869599.131430:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875765554665472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869599.131475:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875765554665472:12345-0@lo:400:kworker.0 Request processed in 45us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869599.131481:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788869599.131503:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788869599.131515:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554665216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869599.131525:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554666496:12345-0@lo:400:kworker.0 Request processed in 55us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869599.131536:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788869599.131564:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554665216:12345-0@lo:400:kworker.0 Request processed in 52us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869599.131574:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788869599.131583:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788869599.131603:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788869599.131605:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875765554665728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869599.131620:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875765554666240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869599.131675:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875765554665728:12345-0@lo:400:kworker.0 Request processed in 80us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869599.131678:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875765554666240:12345-0@lo:400:kworker.0 Request processed in 61us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869599.131700:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788869599.131949:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869599.132033:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554666752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869599.132072:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869599.132111:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554665600 00000100:00100000:1.0:1788869599.132115:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554665600 00000100:00100000:2.0:1788869599.132366:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788869599.132386:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788869599.132394:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554665856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869599.132436:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554665856:12345-0@lo:400:kworker.0 Request processed in 42us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869599.132443:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788869599.132455:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788869599.132461:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554666368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869599.132493:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554666368:12345-0@lo:400:kworker.0 Request processed in 32us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869599.132500:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788869599.132526:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554665344 00000100:00080000:2.0:1788869599.132531:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869599.132536:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554665344 00000100:00080000:2.0:1788869599.132538:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869599.132542:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869599.132548:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788869599.132581:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfa48380 x1875765554665856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869599.132597:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554665856:0@lo:400:kworker.0 00010000:00080000:2.0:1788869599.132612:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfa49880 x1875765554666368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869599.132622:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554666368:0@lo:400:kworker.0 00000100:00100000:2.0:1788869599.132635:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554665216:0@lo:400:kworker.0 00000100:00100000:2.0:1788869599.132647:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875765554665728:0@lo:400:kworker.0 00000100:00100000:2.0:1788869599.132657:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875765554666240:0@lo:400:kworker.0 00000100:00100000:2.0:1788869599.132693:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875765554665472:0@lo:400:kworker.0 00010000:00080000:2.0:1788869599.132707:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfa4bb80 x1875765554665984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869599.132727:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554665984:0@lo:400:kworker.0 00000100:00100000:0.0:1788869599.132742:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788869599.132761:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554665600:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788869599.132766:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfa4ad80 x1875765554666496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869599.132780:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554666496:0@lo:400:kworker.0 00010000:00080000:2.0:1788869599.132799:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfa4b800 x1875765554666112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869599.132810:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554666112:0@lo:400:kworker.0 00000100:00100000:0.0:1788869599.132832:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554665600:12345-0@lo:400:kworker.0 Request processed in 71us (3026us total) trans 0 rc 0/0 00010000:00080000:2.0:1788869599.132835:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfa49f80 x1875765554666624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869599.132853:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788869599.132857:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554666624:0@lo:400:kworker.0 00000100:00100000:0.0:1788869599.132905:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788869599.132909:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554665600:0@lo:400:kworker.0 00000100:00100000:0.0:1788869599.132917:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554665344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869599.132967:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554665344:12345-0@lo:400:kworker.0 Request processed in 55us (2048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869599.132973:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788869599.133049:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554666752 00000100:00100000:1.0:1788869599.133056:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554666752 00000100:00100000:1.0:1788869599.133091:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788869599.133098:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554666752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788869599.133118:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869599.133173:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554666752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869599.133182:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1788869599.133205:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839c9180 x1875765554666752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869615 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869599.133232:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554666752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869599.134273:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554665344:0@lo:400:kworker.0 00010000:00010000:3.0:1788869599.262212:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869600.282547:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869600.884501:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869600.884579:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869600.884612:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869600.884650:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869600.884671:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869600.884697:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869600.884746:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869600.884781:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545154944 00000100:00100000:0.0:1788869600.884791:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545154944 00000100:00100000:0.0:1788869600.884844:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545155200 00000100:00100000:0.0:1788869600.884848:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545155200 00000100:00100000:0.0:1788869600.884860:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545154816 00000100:00100000:0.0:1788869600.884861:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545154816 00000100:00100000:0.0:1788869600.884871:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545155072 00000100:00100000:0.0:1788869600.884874:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545155072 00000100:00100000:2.0:1788869600.885132:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545154688 00000100:00100000:2.0:1788869600.885136:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545154688 00000100:00100000:2.0:1788869600.885168:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 302 00000100:00100000:2.0:1788869600.885178:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2388:x1875765545154688:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869600.885245:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2388:x1875765545154688:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 68us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869600.885294:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 302 00000100:00100000:2.0:1788869600.885328:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545155456 00000100:00100000:2.0:1788869600.885331:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545155456 00000100:00100000:2.0:1788869600.885357:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545155328 00000100:00100000:2.0:1788869600.885371:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545155328 00000100:00100000:2.0:1788869600.885397:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:2.0:1788869600.885403:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85067cd6-7cd1-4166-bc53-2e9768411f07+6:2388:x1875765545155456:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869600.885434:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85067cd6-7cd1-4166-bc53-2e9768411f07+6:2388:x1875765545155456:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 31us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869600.885441:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:2.0:1788869600.885452:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:2.0:1788869600.885458:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85067cd6-7cd1-4166-bc53-2e9768411f07+6:2388:x1875765545155328:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869600.885483:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85067cd6-7cd1-4166-bc53-2e9768411f07+6:2388:x1875765545155328:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869600.885489:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:0.0:1788869600.885591:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 139 00000100:00100000:0.0:1788869600.885604:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2388:x1875765545154944:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869600.885634:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2388:x1875765545154944:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 34us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869600.892077:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 140 00000100:00100000:2.0:1788869600.892107:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+6:2388:x1875765545155200:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869600.892187:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+6:2388:x1875765545155200:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 97us (7573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869600.892196:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 140 00000100:00100000:2.0:1788869600.892229:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 141 00000100:00100000:2.0:1788869600.892237:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+6:2388:x1875765545154816:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869600.892277:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+6:2388:x1875765545154816:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 41us (7604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869600.892284:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 141 00000100:00100000:2.0:1788869600.892297:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 142 00000100:00100000:2.0:1788869600.892304:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+6:2388:x1875765545155072:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869600.892349:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+6:2388:x1875765545155072:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 46us (7652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869600.892356:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 142 00000100:00080000:2.0:1788869600.892389:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788869600.892394:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869600.892398:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869600.892401:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869600.896514:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 139 00000100:00100000:3.0:1788869601.176510:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869601.176539:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554666880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869601.176695:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869601.176782:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554666880 00000100:00100000:3.0:1788869601.176790:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554666880 00000100:00100000:3.0:1788869601.176841:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788869601.176850:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554666880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869601.176884:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869601.176932:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554666880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869601.176939:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:3.0:1788869601.176981:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf982300 x1875765554666880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788869601.176989:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869601.177003:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554666880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869601.178187:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554667008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869601.178243:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869601.178326:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554667008 00000100:00100000:1.0:1788869601.178332:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554667008 00000100:00100000:1.0:1788869601.178378:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788869601.178388:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554667008:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788869601.178405:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788869601.178406:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869601.178464:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554667008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869601.178471:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1788869601.178508:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839caa00 x1875765554667008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869601.178533:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554667008:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788869601.180844:0:8393:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 85067cd6-7cd1-4166-bc53-2e9768411f07 00000001:00100000:0.0:1788869601.182296:0:9476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 85067cd6-7cd1-4166-bc53-2e9768411f07 00000001:00100000:2.0:1788869601.182376:0:6463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 85067cd6-7cd1-4166-bc53-2e9768411f07 00000001:00100000:3.0:1788869601.182700:0:7415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 85067cd6-7cd1-4166-bc53-2e9768411f07 00010000:00010000:3.0:1788869601.304591:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869601.691459:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554667136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869601.691567:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869601.691677:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554667136 00000100:00100000:2.0:1788869601.691687:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554667136 00000100:00100000:2.0:1788869601.691781:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788869601.691793:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554667136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869601.691839:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869601.691893:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554667136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869601.691901:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788869601.691954:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554667136:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1788869602.113414:0:12153:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1788869602.328440:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869603.352402:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869603.738549:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869603.738572:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554667264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869603.738775:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869603.739127:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869603.739140:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554667392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869603.739198:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869603.739286:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554667392 00000100:00100000:3.0:1788869603.739294:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554667392 00000100:00100000:3.0:1788869603.739341:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788869603.739350:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554667392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869603.739382:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788869603.739449:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554667392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869603.739458:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788869603.739599:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554667392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869603.739855:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554667264 00000100:00100000:0.0:1788869603.739861:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554667264 00000100:00100000:0.0:1788869603.739944:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788869603.739953:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffba0d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554667264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869603.739974:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869603.740014:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffba0d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554667264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869603.740021:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:0.0:1788869603.740208:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839caa00 x1875765554667264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869619 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869603.740224:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554667264:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788869603.744495:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869604.248603:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554667776:0@lo:400:kworker.0 00000100:00100000:0.0:1788869604.248693:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869604.248755:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554668288:0@lo:400:kworker.0 00000100:00100000:0.0:1788869604.248791:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869604.248810:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554668800:0@lo:400:kworker.0 00000100:00100000:0.0:1788869604.248830:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869604.248850:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788869604.248856:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554667904:0@lo:400:kworker.0 00000100:00100000:0.0:1788869604.248877:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869604.248900:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554668416:0@lo:400:kworker.0 00000100:00100000:0.0:1788869604.248934:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869604.248952:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554668928:0@lo:400:kworker.0 00000100:00100000:0.0:1788869604.248976:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869604.249011:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554667776 00000100:00100000:0.0:1788869604.249017:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554667776 00000100:00100000:0.0:1788869604.249060:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788869604.249068:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554667776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869604.249127:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554667776:12345-0@lo:400:kworker.0 Request processed in 59us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869604.249138:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788869604.249158:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554668288 00000100:00100000:0.0:1788869604.249161:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554668288 00000100:00100000:0.0:1788869604.249188:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554668800 00000100:00100000:0.0:1788869604.249191:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554668800 00000100:00100000:0.0:1788869604.249202:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554667904 00000100:00100000:0.0:1788869604.249204:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554667904 00000100:00100000:0.0:1788869604.249216:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788869604.249221:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554668288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869604.249249:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554668288:12345-0@lo:400:kworker.0 Request processed in 28us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869604.249278:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788869604.249290:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788869604.249296:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554668800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869604.249320:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554668800:12345-0@lo:400:kworker.0 Request processed in 25us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869604.249326:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788869604.249336:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788869604.249349:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554667904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869604.249377:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554667904:12345-0@lo:400:kworker.0 Request processed in 29us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869604.249383:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788869604.249402:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554668416 00000100:00100000:0.0:1788869604.249405:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554668416 00000100:00100000:0.0:1788869604.249429:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554668928 00000100:00100000:0.0:1788869604.249431:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554668928 00000100:00100000:0.0:1788869604.249449:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788869604.249457:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554668416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869604.249487:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554668416:12345-0@lo:400:kworker.0 Request processed in 31us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869604.249492:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788869604.249502:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788869604.249508:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554668928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869604.249532:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554668928:12345-0@lo:400:kworker.0 Request processed in 24us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869604.249537:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1788869604.249556:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869604.249560:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788869604.249563:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869604.249596:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554667904:0@lo:400:kworker.0 00010000:00080000:0.0:1788869604.249609:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82325c00 x1875765554668416/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869604.249620:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554668416:0@lo:400:kworker.0 00010000:00080000:0.0:1788869604.249630:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8228d180 x1875765554668928/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869604.249646:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554668928:0@lo:400:kworker.0 00000100:00100000:0.0:1788869604.249657:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554667776:0@lo:400:kworker.0 00010000:00080000:0.0:1788869604.249665:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ff84be4a80 x1875765554668288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869604.249673:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554668288:0@lo:400:kworker.0 00010000:00080000:0.0:1788869604.249696:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82325500 x1875765554668800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869604.249706:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554668800:0@lo:400:kworker.0 00000100:00100000:2.0:1788869604.249835:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554667520:0@lo:400:kworker.0 00000100:00100000:2.0:1788869604.249879:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869604.249916:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554668032:0@lo:400:kworker.0 00000100:00100000:2.0:1788869604.249939:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869604.249958:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554668544:0@lo:400:kworker.0 00000100:00100000:2.0:1788869604.249978:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869604.249992:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554669056:0@lo:400:kworker.0 00000100:00100000:2.0:1788869604.250013:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869604.250029:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788869604.250033:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554667648:0@lo:400:kworker.0 00000100:00100000:2.0:1788869604.250053:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869604.250065:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554668160:0@lo:400:kworker.0 00000100:00100000:2.0:1788869604.250082:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869604.250095:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554668672:0@lo:400:kworker.0 00000100:00100000:2.0:1788869604.250112:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869604.250132:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554668544 00000100:00100000:2.0:1788869604.250136:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554668544 00000100:00100000:2.0:1788869604.250160:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554669056 00000100:00100000:2.0:1788869604.250162:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554669056 00000100:00100000:2.0:1788869604.250174:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788869604.250178:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554668544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869604.250212:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554668544:12345-0@lo:400:kworker.0 Request processed in 33us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869604.250218:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788869604.250237:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788869604.250242:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554669056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869604.250299:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554669056:12345-0@lo:400:kworker.0 Request processed in 56us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869604.250304:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788869604.250318:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554668032 00000100:00100000:2.0:1788869604.250321:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554668032 00000100:00100000:2.0:1788869604.250340:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788869604.250345:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554668032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869604.250369:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554668032:12345-0@lo:400:kworker.0 Request processed in 25us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869604.250374:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788869604.250399:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554668032:0@lo:400:kworker.0 00010000:00080000:2.0:1788869604.250408:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82325f80 x1875765554668544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869604.250416:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554668544:0@lo:400:kworker.0 00010000:00080000:2.0:1788869604.250425:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8228d880 x1875765554669056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869604.250433:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554669056:0@lo:400:kworker.0 00000100:00100000:3.0:1788869604.250521:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554667648 00000100:00100000:3.0:1788869604.250525:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554667648 00000100:00100000:3.0:1788869604.250545:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554668160 00000100:00100000:3.0:1788869604.250548:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554668160 00000100:00100000:3.0:1788869604.250558:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554668672 00000100:00100000:3.0:1788869604.250561:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554668672 00000100:00100000:3.0:1788869604.250576:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788869604.250582:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554667648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869604.250638:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554667648:12345-0@lo:400:kworker.0 Request processed in 57us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869604.250644:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788869604.250657:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788869604.250663:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554668160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869604.250698:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554668160:12345-0@lo:400:kworker.0 Request processed in 35us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869604.250703:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788869604.250714:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788869604.250725:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554668672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869604.250753:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554668672:12345-0@lo:400:kworker.0 Request processed in 29us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869604.250754:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554667648:0@lo:400:kworker.0 00000100:00100000:3.0:1788869604.250759:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788869604.250764:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554668160:0@lo:400:kworker.0 00000100:00100000:2.0:1788869604.250772:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554668672:0@lo:400:kworker.0 00000100:00100000:0.0:1788869604.251059:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554667520 00000100:00100000:0.0:1788869604.251064:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554667520 00000100:00100000:0.0:1788869604.251166:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788869604.251175:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554667520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869604.251221:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554667520:12345-0@lo:400:kworker.0 Request processed in 48us (1341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869604.251227:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788869604.251649:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554667520:0@lo:400:kworker.0 00000100:00080000:1.0:1788869604.251823:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869604.251828:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869604.251928:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554669184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869604.251964:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869604.252330:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554669184 00000100:00100000:1.0:1788869604.252335:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554669184 00000100:00100000:1.0:1788869604.252372:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788869604.252379:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554669184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788869604.252396:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869604.252435:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554669184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869604.252441:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1788869604.252516:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839caa00 x1875765554669184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869620 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869604.252532:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554669184:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788869604.376514:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869605.403068:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869605.995920:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869605.996002:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869605.996102:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869605.996138:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869605.996164:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869605.996212:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545156224 00000100:00100000:2.0:1788869605.996235:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545156224 00000100:00100000:2.0:1788869605.996321:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:2.0:1788869605.996331:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545156224:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869605.996395:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545156224:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 65us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869605.996402:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:2.0:1788869605.996438:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545155584 00000100:00100000:2.0:1788869605.996441:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545155584 00000100:00100000:2.0:1788869605.996462:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 304 00000100:00100000:2.0:1788869605.996468:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2390:x1875765545155584:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869605.996488:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2390:x1875765545155584:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 20us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869605.996494:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 304 00000100:00080000:2.0:1788869605.996522:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869606.002573:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545155712 00000100:00100000:3.0:1788869606.002589:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545155712 00000100:00100000:3.0:1788869606.002767:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545155968 00000100:00100000:3.0:1788869606.002770:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545155968 00000100:00100000:3.0:1788869606.002817:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 149 00000100:00100000:3.0:1788869606.002826:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:2390:x1875765545155712:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869606.002909:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:2390:x1875765545155712:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 83us (6998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869606.002916:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 149 00000100:00100000:3.0:1788869606.002934:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 150 00000100:00100000:3.0:1788869606.002940:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545155968:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869606.002964:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545155968:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (6962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869606.002970:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 150 00000100:00080000:3.0:1788869606.002997:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869606.004710:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869606.004742:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869606.004771:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545156352 00000100:00100000:1.0:1788869606.004778:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545156352 00000100:00100000:1.0:1788869606.004827:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:1.0:1788869606.004836:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545156352:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869606.004894:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545156352:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 59us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869606.004901:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00080000:3.0:1788869606.005578:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869606.005594:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545155840 00000100:00100000:3.0:1788869606.005599:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545155840 00000100:00100000:3.0:1788869606.005642:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545156096 00000100:00100000:3.0:1788869606.005646:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545156096 00000100:00100000:3.0:1788869606.005671:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 151 00000100:00100000:3.0:1788869606.005679:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545155840:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869606.005717:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545155840:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 39us (9552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869606.005723:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 151 00000100:00100000:3.0:1788869606.005736:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 152 00000100:00100000:3.0:1788869606.005741:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545156096:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869606.005762:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545156096:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869606.005778:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 152 00000100:00080000:1.0:1788869606.006695:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869606.296587:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869606.296609:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554669312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869606.296694:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869606.296897:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554669312 00000100:00100000:3.0:1788869606.296905:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554669312 00000100:00100000:3.0:1788869606.296964:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788869606.296975:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554669312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869606.297003:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869606.297048:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554669312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869606.297056:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1788869606.297111:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf983800 x1875765554669312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869606.297129:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554669312:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788869606.297269:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869606.297903:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869606.297916:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554669440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869606.297950:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869606.298245:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554669440 00000100:00100000:3.0:1788869606.298266:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554669440 00000100:00100000:3.0:1788869606.298313:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788869606.298321:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554669440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869606.298334:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869606.298366:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554669440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869606.298373:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1788869606.298726:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788869606.299291:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf927480 x1875765554669440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869606.299311:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554669440:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788869606.424464:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869606.809085:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869606.809123:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554669568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869606.809189:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869606.810239:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554669568 00000100:00100000:2.0:1788869606.810249:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554669568 00000100:00100000:2.0:1788869606.810323:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788869606.810332:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554669568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869606.810369:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869606.810444:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554669568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869606.810458:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788869606.810559:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554669568:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788869607.448431:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788869608.340956:0:12468:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869608.341178:0:12468:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788869608.472361:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869608.858215:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554669696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869608.858339:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869608.858894:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554669696 00000100:00100000:1.0:1788869608.858904:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554669696 00000100:00100000:1.0:1788869608.858971:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788869608.858981:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554669696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788869608.859013:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869608.859075:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554669696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869608.859082:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1788869608.859568:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839c8a80 x1875765554669696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869624 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869608.859605:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554669696:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788869608.860943:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869608.862240:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554669824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869608.862372:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869608.862772:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554669824 00000100:00100000:1.0:1788869608.862780:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554669824 00000100:00100000:1.0:1788869608.862852:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788869608.862863:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554669824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869608.862903:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788869608.865172:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554669824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2305us (2794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869608.865186:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788869608.865349:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554669824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869609.370441:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554669952:0@lo:400:kworker.0 00000100:00100000:3.0:1788869609.370512:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869609.370575:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554670464:0@lo:400:kworker.0 00000100:00100000:3.0:1788869609.370802:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869609.370832:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554670976:0@lo:400:kworker.0 00000100:00100000:3.0:1788869609.370860:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869609.370876:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554671488:0@lo:400:kworker.0 00000100:00100000:3.0:1788869609.370897:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869609.370918:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788869609.370924:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554670336:0@lo:400:kworker.0 00000100:00100000:3.0:1788869609.370945:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869609.370961:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554670848:0@lo:400:kworker.0 00000100:00100000:3.0:1788869609.370980:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869609.370998:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554671360:0@lo:400:kworker.0 00000100:00100000:3.0:1788869609.371017:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869609.371042:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554670080:0@lo:400:kworker.0 00000100:00100000:2.0:1788869609.371168:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554670464 00000100:00100000:2.0:1788869609.371176:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554670464 00000100:00100000:2.0:1788869609.371223:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788869609.371232:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554670464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869609.371308:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554670464:12345-0@lo:400:kworker.0 Request processed in 77us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869609.371315:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788869609.371336:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554670976 00000100:00100000:2.0:1788869609.371339:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554670976 00000100:00100000:2.0:1788869609.371365:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554671488 00000100:00100000:2.0:1788869609.371367:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554671488 00000100:00100000:2.0:1788869609.371377:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554670848 00000100:00100000:2.0:1788869609.371378:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554670848 00000100:00100000:2.0:1788869609.371389:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554671360 00000100:00100000:2.0:1788869609.371391:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554671360 00000100:00100000:2.0:1788869609.371403:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788869609.371409:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554670976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869609.371451:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554670976:12345-0@lo:400:kworker.0 Request processed in 41us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869609.371456:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788869609.371467:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788869609.371473:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554671488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869609.371495:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554671488:12345-0@lo:400:kworker.0 Request processed in 23us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869609.371499:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788869609.371509:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788869609.371514:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554670848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869609.371539:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554670848:12345-0@lo:400:kworker.0 Request processed in 25us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869609.371552:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788869609.371563:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788869609.371567:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554671360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869609.371592:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554671360:12345-0@lo:400:kworker.0 Request processed in 24us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869609.371597:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1788869609.371655:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf981500 x1875765554670848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869609.371668:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554670848:0@lo:400:kworker.0 00010000:00080000:2.0:1788869609.371679:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf983100 x1875765554671360/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869609.371688:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554671360:0@lo:400:kworker.0 00000100:00100000:2.0:1788869609.371696:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554670464:0@lo:400:kworker.0 00010000:00080000:2.0:1788869609.371704:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf983480 x1875765554670976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869609.371712:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554670976:0@lo:400:kworker.0 00010000:00080000:2.0:1788869609.371720:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf983800 x1875765554671488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869609.371727:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554671488:0@lo:400:kworker.0 00000100:00080000:2.0:1788869609.371754:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869609.371757:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869609.371925:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869609.371947:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554670592:0@lo:400:kworker.0 00000100:00100000:3.0:1788869609.371975:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869609.371990:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554671104:0@lo:400:kworker.0 00000100:00100000:3.0:1788869609.372007:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869609.372024:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554671616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869609.372045:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869609.372166:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788869609.372175:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554670208:0@lo:400:kworker.0 00000100:00100000:3.0:1788869609.372202:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869609.372230:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554670720:0@lo:400:kworker.0 00000100:00100000:3.0:1788869609.372267:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869609.372279:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875765554671232:0@lo:400:kworker.0 00000100:00100000:3.0:1788869609.372299:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869609.372325:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554670336 00000100:00100000:3.0:1788869609.372329:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554670336 00000100:00100000:3.0:1788869609.372352:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554670080 00000100:00100000:3.0:1788869609.372355:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554670080 00000100:00100000:3.0:1788869609.372367:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554670592 00000100:00100000:3.0:1788869609.372369:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554670592 00000100:00100000:3.0:1788869609.372386:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554671104 00000100:00100000:3.0:1788869609.372389:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554671104 00000100:00100000:3.0:1788869609.372403:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554670720 00000100:00100000:3.0:1788869609.372406:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554670720 00000100:00100000:3.0:1788869609.372417:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554671232 00000100:00100000:3.0:1788869609.372420:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554671232 00000100:00100000:3.0:1788869609.372894:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788869609.372902:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554670336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869609.372949:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554670336:12345-0@lo:400:kworker.0 Request processed in 48us (2003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869609.372956:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788869609.372971:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788869609.372977:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554670080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869609.373011:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554670080:12345-0@lo:400:kworker.0 Request processed in 34us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869609.373016:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788869609.373027:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788869609.373032:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8208ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554670592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869609.373361:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554671616 00000100:00100000:1.0:1788869609.373367:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554671616 00000100:00100000:1.0:1788869609.373400:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788869609.373408:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554671616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788869609.373424:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869609.373508:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788869609.373519:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8208b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554671104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869609.374496:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554669952 00000100:00100000:0.0:1788869609.374506:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554669952 00000100:00100000:0.0:1788869609.374545:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788869609.374553:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554669952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869609.374965:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554671616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1556us (2916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869609.374974:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788869609.375000:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554670208 00000100:00100000:1.0:1788869609.375014:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554670208 00000100:00100000:1.0:1788869609.375041:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788869609.375047:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554670208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869609.375344:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554670208:12345-0@lo:400:kworker.0 Request processed in 296us (3141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869609.375351:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788869609.379065:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8208b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554671104:12345-0@lo:400:kworker.0 Request processed in 5540us (7047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869609.379082:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788869609.379122:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788869609.379136:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554670720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869609.379186:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554670720:12345-0@lo:400:kworker.0 Request processed in 56us (6932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869609.379192:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788869609.379204:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788869609.379210:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8208a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875765554671232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869609.379241:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8208a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875765554671232:12345-0@lo:400:kworker.0 Request processed in 31us (6942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869609.379247:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:2.0:1788869609.379293:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869609.379298:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869609.379339:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554670336:0@lo:400:kworker.0 00000100:00100000:3.0:1788869609.379501:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8208ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554670592:12345-0@lo:400:kworker.0 Request processed in 6467us (7524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869609.379509:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788869609.379549:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554670208:0@lo:400:kworker.0 00010000:00080000:3.0:1788869609.379565:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf981180 x1875765554670720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869609.379576:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554670720:0@lo:400:kworker.0 00010000:00080000:3.0:1788869609.379588:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf980380 x1875765554671232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869609.379597:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf980380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875765554671232:0@lo:400:kworker.0 00000100:00100000:3.0:1788869609.379610:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554670080:0@lo:400:kworker.0 00000100:00100000:3.0:1788869609.379621:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554670592:0@lo:400:kworker.0 00000100:00100000:3.0:1788869609.379641:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554671104:0@lo:400:kworker.0 00010000:00080000:3.0:1788869609.379654:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf925c00 x1875765554671616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869625 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869609.379668:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554671616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869609.381477:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554669952:12345-0@lo:400:kworker.0 Request processed in 6916us (10956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869609.381492:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788869609.385078:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554669952:0@lo:400:kworker.0 00010000:00010000:3.0:1788869609.497413:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788869610.447542:0:12565:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788869610.447785:0:12565:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788869610.525712:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869611.111053:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869611.111154:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869611.111186:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869611.111221:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869611.111248:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869611.111295:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869611.111317:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869611.111341:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545157248 00000100:00100000:1.0:1788869611.111351:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545157248 00000100:00100000:1.0:1788869611.111429:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545157120 00000100:00100000:1.0:1788869611.111433:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545157120 00000100:00100000:1.0:1788869611.111457:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:1.0:1788869611.111466:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545157248:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869611.111550:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545157248:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 73us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869611.111558:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:1.0:1788869611.111575:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:1.0:1788869611.111581:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545157120:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869611.111758:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545157120:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 176us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869611.111782:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:1.0:1788869611.111802:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545156736 00000100:00100000:1.0:1788869611.111806:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545156736 00000100:00100000:1.0:1788869611.111827:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545156992 00000100:00100000:1.0:1788869611.111830:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545156992 00000100:00100000:1.0:1788869611.111841:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545156608 00000100:00100000:1.0:1788869611.111843:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545156608 00000100:00100000:1.0:1788869611.111855:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545156864 00000100:00100000:1.0:1788869611.111858:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545156864 00000100:00100000:1.0:1788869611.111872:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 159 00000100:00100000:1.0:1788869611.111878:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545156736:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869611.111907:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545156736:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869611.111913:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 159 00000100:00100000:1.0:1788869611.111924:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 160 00000100:00100000:1.0:1788869611.111930:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545156992:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869611.111952:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545156992:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869611.111958:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 160 00000100:00100000:1.0:1788869611.111970:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 161 00000100:00100000:1.0:1788869611.111976:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:2390:x1875765545156608:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869611.111998:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:2390:x1875765545156608:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869611.112004:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 161 00000100:00100000:1.0:1788869611.112015:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 162 00000100:00100000:1.0:1788869611.112027:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545156864:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869611.112051:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545156864:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869611.112057:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 162 00000100:00080000:1.0:1788869611.112082:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869611.112086:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869611.112089:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869611.112091:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869611.112933:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545156480 00000100:00100000:2.0:1788869611.112940:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545156480 00000100:00100000:2.0:1788869611.112977:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 306 00000100:00100000:2.0:1788869611.112984:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2390:x1875765545156480:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869611.113031:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2390:x1875765545156480:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 48us (1989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869611.113038:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 306 00000100:00100000:3.0:1788869611.416918:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8208aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554671744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869611.417000:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869611.417345:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554671744 00000100:00100000:1.0:1788869611.417354:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554671744 00000100:00100000:1.0:1788869611.418511:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788869611.418530:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554671744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869611.418939:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869611.419025:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554671744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 502us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869611.419035:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788869611.419071:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869611.419111:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8208aa00 x1875765554671744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869611.419135:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8208aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554671744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869611.421081:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554671872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869611.421148:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869611.423025:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554671872 00000100:00100000:0.0:1788869611.423038:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554671872 00000100:00100000:0.0:1788869611.423222:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788869611.423236:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554671872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869611.423285:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869611.423369:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554671872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (2220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869611.423385:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1788869611.423758:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788869611.423799:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffb9e07100 x1875765554671872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869611.423820:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554671872:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788869611.545806:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869611.928557:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869611.928579:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554672000:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869611.928658:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869611.928861:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554672000 00000100:00100000:2.0:1788869611.928869:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554672000 00000100:00100000:2.0:1788869611.928922:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788869611.928932:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554672000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869611.928969:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869611.929022:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554672000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869611.929028:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788869611.929367:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554672000:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1788869612.294460:0:12663:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869612.294666:0:12663:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788869612.571822:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869613.592428:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869613.977026:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554672128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869613.977094:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869613.977236:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554672256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869613.977290:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869613.977323:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554672256 00000100:00100000:1.0:1788869613.977330:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554672256 00000100:00080000:3.0:1788869613.977378:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869613.977382:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788869613.977391:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554672256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788869613.977432:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869613.977496:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554672256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869613.977504:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788869613.981357:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554672128 00000100:00100000:0.0:1788869613.981371:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554672128 00000100:00100000:0.0:1788869613.981437:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788869613.981446:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554672128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788869613.981492:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788869613.981569:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554672128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (4474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869613.981576:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788869613.981804:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554672128:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1788869613.984230:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffb9b52d80 x1875765554672256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869629 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869613.984273:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554672256:0@lo:13:osp-pre-1-0.0 00000020:00000004:0.0:1788869614.417785:0:12761:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869614.417940:0:12761:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788869614.488420:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554672384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869614.488492:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869614.488585:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554672384 00000100:00100000:3.0:1788869614.488593:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554672384 00000100:00100000:3.0:1788869614.488651:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788869614.488660:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554672384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869614.488683:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869614.488726:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554672384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869614.488733:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1788869614.488754:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788869614.488786:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839b9f80 x1875765554672384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869630 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869614.488803:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554672384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869614.489615:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554672512:0@lo:400:kworker.0 00000100:00100000:0.0:1788869614.489663:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869614.489693:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554673024:0@lo:400:kworker.0 00000100:00100000:0.0:1788869614.489718:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869614.489735:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554673536:0@lo:400:kworker.0 00000100:00100000:0.0:1788869614.489756:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869614.489775:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788869614.489780:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554672896:0@lo:400:kworker.0 00000100:00100000:0.0:1788869614.489816:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869614.489831:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554673408:0@lo:400:kworker.0 00000100:00100000:0.0:1788869614.489846:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869614.489858:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554673920:0@lo:400:kworker.0 00000100:00100000:0.0:1788869614.490155:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869614.490193:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554672640:0@lo:400:kworker.0 00000100:00100000:0.0:1788869614.490213:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869614.490229:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554673152:0@lo:400:kworker.0 00000100:00100000:0.0:1788869614.490245:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869614.490279:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554673664:0@lo:400:kworker.0 00000100:00100000:0.0:1788869614.490298:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869614.490313:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788869614.490318:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554672768:0@lo:400:kworker.0 00000100:00100000:0.0:1788869614.490336:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869614.490350:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554673280:0@lo:400:kworker.0 00000100:00100000:0.0:1788869614.490366:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869614.490374:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875765554673792:0@lo:400:kworker.0 00000100:00100000:0.0:1788869614.491091:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869614.491127:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554672512 00000100:00100000:0.0:1788869614.491135:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554672512 00000100:00100000:0.0:1788869614.491363:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788869614.491373:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff85f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554672512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869614.491450:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff85f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554672512:12345-0@lo:400:kworker.0 Request processed in 79us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869614.491467:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788869614.491541:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554672512:0@lo:400:kworker.0 00000100:00100000:2.0:1788869614.496618:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554673024 00000100:00100000:2.0:1788869614.496633:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554673024 00000100:00100000:2.0:1788869614.496686:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554672768 00000100:00100000:2.0:1788869614.496690:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554672768 00000100:00100000:2.0:1788869614.496710:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788869614.496719:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554673024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869614.496823:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554673024:12345-0@lo:400:kworker.0 Request processed in 104us (7102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869614.496830:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788869614.496848:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788869614.496854:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554672768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869614.496905:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554672768:12345-0@lo:400:kworker.0 Request processed in 51us (6567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869614.496920:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788869614.496949:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554672896 00000100:00100000:2.0:1788869614.496954:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554672896 00000100:00100000:2.0:1788869614.496970:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554672640 00000100:00100000:2.0:1788869614.496973:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554672640 00000100:00100000:2.0:1788869614.497222:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554673152 00000100:00100000:2.0:1788869614.497226:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554673152 00000100:00100000:2.0:1788869614.497273:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554673664 00000100:00100000:2.0:1788869614.497277:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554673664 00000100:00100000:2.0:1788869614.497292:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554673280 00000100:00100000:2.0:1788869614.497295:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554673280 00000100:00100000:2.0:1788869614.497308:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554673792 00000100:00100000:2.0:1788869614.497311:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554673792 00000100:00100000:2.0:1788869614.497323:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788869614.497329:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554672896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869614.497364:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554672896:12345-0@lo:400:kworker.0 Request processed in 34us (7547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869614.497370:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788869614.497392:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788869614.497397:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554672640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869614.497425:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554672640:12345-0@lo:400:kworker.0 Request processed in 28us (7210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869614.497431:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788869614.497440:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788869614.497446:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554673152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869614.497471:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554673152:12345-0@lo:400:kworker.0 Request processed in 25us (7224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869614.497476:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788869614.497495:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788869614.497501:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554673664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869614.497530:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554673664:12345-0@lo:400:kworker.0 Request processed in 29us (7231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869614.497536:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788869614.497546:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788869614.497563:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554673280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869614.497602:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554673280:12345-0@lo:400:kworker.0 Request processed in 50us (7234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869614.497608:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788869614.497620:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788869614.497626:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf901880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875765554673792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869614.497656:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf901880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875765554673792:12345-0@lo:400:kworker.0 Request processed in 31us (6565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869614.497662:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788869614.497690:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554673536 00000100:00100000:2.0:1788869614.497695:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554673536 00000100:00100000:2.0:1788869614.497720:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554673408 00000100:00100000:2.0:1788869614.497723:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554673408 00000100:00100000:2.0:1788869614.497735:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554673920 00000100:00100000:2.0:1788869614.497738:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554673920 00000100:00100000:2.0:1788869614.497748:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788869614.497753:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554673536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869614.497783:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554673536:12345-0@lo:400:kworker.0 Request processed in 30us (8027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869614.497789:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788869614.497799:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788869614.497811:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554673408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869614.497841:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554673408:12345-0@lo:400:kworker.0 Request processed in 31us (7993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869614.497846:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788869614.497856:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788869614.497861:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf900e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554673920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869614.497885:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf900e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554673920:12345-0@lo:400:kworker.0 Request processed in 24us (7730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869614.497890:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1788869614.497917:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788869614.497921:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869614.497923:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869614.498191:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554672768:0@lo:400:kworker.0 00010000:00080000:2.0:1788869614.498206:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82327480 x1875765554673280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869614.498216:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554673280:0@lo:400:kworker.0 00010000:00080000:2.0:1788869614.498227:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffac4efb80 x1875765554673792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869614.498235:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875765554673792:0@lo:400:kworker.0 00000100:00100000:2.0:1788869614.498245:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554672640:0@lo:400:kworker.0 00000100:00100000:2.0:1788869614.498275:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554673152:0@lo:400:kworker.0 00000100:00100000:2.0:1788869614.498287:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554673664:0@lo:400:kworker.0 00000100:00100000:2.0:1788869614.498330:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554672896:0@lo:400:kworker.0 00010000:00080000:2.0:1788869614.498351:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82325f80 x1875765554673408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869614.498361:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554673408:0@lo:400:kworker.0 00010000:00080000:2.0:1788869614.498372:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffac4edc00 x1875765554673920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869614.498517:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554673920:0@lo:400:kworker.0 00000100:00100000:2.0:1788869614.498532:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554673024:0@lo:400:kworker.0 00010000:00080000:2.0:1788869614.498543:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82325500 x1875765554673536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869614.498550:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554673536:0@lo:400:kworker.0 00010000:00010000:3.0:1788869614.628220:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869615.640462:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869616.246589:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869616.246625:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869616.246652:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869616.246677:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869616.246697:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869616.246715:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869616.246756:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869616.246785:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545158016 00000100:00100000:3.0:1788869616.246795:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545158016 00000100:00100000:3.0:1788869616.246852:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545158144 00000100:00100000:3.0:1788869616.246855:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545158144 00000100:00100000:3.0:1788869616.246879:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:3.0:1788869616.246889:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2386:x1875765545158016:12345-192.168.201.30@tcp:9:kworker.0 00000020:00000080:3.0:1788869616.247290:0:8399:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2d1c 00000100:00080000:3.0:1788869616.247301:0:8399:0:(import.c:65:import_set_state_nolock()) ffff99fe81cb2800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788869616.247347:0:8399:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788869616.247515:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85067cd6-7cd1-4166-bc53-2e9768411f07+2:2386:x1875765545158016:12345-192.168.201.30@tcp:9:kworker.0 Request processed in 625us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869616.247523:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:3.0:1788869616.247541:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:3.0:1788869616.247548:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2386:x1875765545158144:12345-192.168.201.30@tcp:9:kworker.0 00000020:00000080:3.0:1788869616.247573:0:8399:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2d23 00000100:00080000:3.0:1788869616.247579:0:8399:0:(import.c:65:import_set_state_nolock()) ffff99ffb9b2c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788869616.247602:0:8399:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788869616.247674:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85067cd6-7cd1-4166-bc53-2e9768411f07+2:2386:x1875765545158144:12345-192.168.201.30@tcp:9:kworker.0 Request processed in 126us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869616.247697:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:3.0:1788869616.247723:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545157376 00000100:00100000:3.0:1788869616.247727:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545157376 00000100:00100000:3.0:1788869616.247754:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 308 00000100:00100000:3.0:1788869616.247761:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2387:x1875765545157376:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869616.247786:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2387:x1875765545157376:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869616.247792:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 308 00000100:00100000:3.0:1788869616.247820:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545157632 00000100:00100000:3.0:1788869616.247823:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545157632 00000100:00100000:3.0:1788869616.247842:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545157888 00000100:00100000:3.0:1788869616.247845:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545157888 00000100:00100000:3.0:1788869616.247856:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545157504 00000100:00100000:3.0:1788869616.247858:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545157504 00000100:00100000:3.0:1788869616.247868:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545157760 00000100:00100000:3.0:1788869616.247870:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545157760 00000100:00100000:3.0:1788869616.247883:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 169 00000100:00100000:3.0:1788869616.247889:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545157632:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869616.248861:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545157632:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 968us (2178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869616.248869:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 169 00000100:00100000:3.0:1788869616.248892:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 170 00000100:00100000:3.0:1788869616.248911:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545157888:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869616.248933:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545157888:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (2236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869616.248939:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 170 00000100:00100000:3.0:1788869616.248962:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 171 00000100:00100000:3.0:1788869616.248968:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2387:x1875765545157504:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869616.248996:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2387:x1875765545157504:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (2279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869616.249002:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 171 00000100:00100000:3.0:1788869616.249014:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 172 00000100:00100000:3.0:1788869616.249020:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545157760:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869616.249044:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545157760:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (2288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869616.249050:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 172 00000100:00080000:3.0:1788869616.249080:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869616.249084:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869616.249087:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869616.249089:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788869616.249105:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869616.252118:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869616.536551:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869616.536586:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554674048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869616.536669:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869616.536952:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554674048 00000100:00100000:0.0:1788869616.536961:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554674048 00000100:00100000:0.0:1788869616.537020:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788869616.537030:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554674048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869616.537058:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869616.537099:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554674048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869616.537106:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:0.0:1788869616.537142:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf901180 x1875765554674048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869632 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869616.537160:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554674048:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788869616.537382:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869616.539623:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8335df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554674176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869616.539695:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869616.540479:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554674176 00000100:00100000:0.0:1788869616.540488:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554674176 00000100:00100000:0.0:1788869616.540572:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788869616.540582:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554674176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788869616.540604:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869616.540664:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554674176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869616.540671:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:0.0:1788869616.540712:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8335df80 x1875765554674176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869632 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869616.540730:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8335df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554674176:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788869616.540781:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788869616.667313:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869617.059454:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8335e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554674304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869617.059530:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869617.059680:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554674304 00000100:00100000:3.0:1788869617.059689:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554674304 00000100:00100000:3.0:1788869617.059742:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788869617.059751:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554674304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869617.059782:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788869617.064220:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554674304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4460us (4680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869617.065114:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788869617.075500:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8335e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554674304:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1788869617.514064:0:12858:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788869617.514606:0:12858:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788869617.693872:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869618.712898:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869619.096576:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554674432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869619.096652:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869619.096765:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554674432 00000100:00100000:0.0:1788869619.096774:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554674432 00000100:00100000:0.0:1788869619.096841:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788869619.096850:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554674432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788869619.096883:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788869619.096929:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554674432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869619.096936:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788869619.097016:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554674432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869619.097229:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869619.097238:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554674560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869619.097294:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869619.097528:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554674560 00000100:00100000:1.0:1788869619.097541:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554674560 00000100:00100000:1.0:1788869619.097588:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788869619.097596:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf901180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554674560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788869619.097614:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869619.097654:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf901180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554674560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869619.097661:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:1.0:1788869619.097689:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffb9b50a80 x1875765554674560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869635 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869619.097703:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554674560:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788869619.097771:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869619.613031:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554674816:0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.613116:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869619.613178:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554675328:0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.613201:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869619.613219:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554675840:0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.613240:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869619.613300:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788869619.613307:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554674688:0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.613334:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869619.613354:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554675200:0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.613374:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869619.613391:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875765554675712:0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.613411:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869619.613442:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554674944:0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.613466:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869619.613477:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554675456:0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.613499:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869619.613516:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554675968:0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.613547:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869619.613567:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788869619.613573:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554675072:0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.613597:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869619.613615:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554675584:0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.613636:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869619.613667:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554674816 00000100:00100000:2.0:1788869619.613680:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554674816 00000100:00100000:2.0:1788869619.613717:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554675328 00000100:00100000:2.0:1788869619.613721:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554675328 00000100:00100000:2.0:1788869619.613743:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554675840 00000100:00100000:2.0:1788869619.613746:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554675840 00000100:00100000:2.0:1788869619.613756:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554675200 00000100:00100000:2.0:1788869619.613758:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554675200 00000100:00100000:2.0:1788869619.613767:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554675712 00000100:00100000:2.0:1788869619.613768:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554675712 00000100:00100000:2.0:1788869619.613777:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554674944 00000100:00100000:2.0:1788869619.613779:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554674944 00000100:00100000:2.0:1788869619.613791:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788869619.613798:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554674816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.613848:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554674816:12345-0@lo:400:kworker.0 Request processed in 49us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869619.613854:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788869619.613870:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788869619.613876:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875765554675328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.613903:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875765554675328:12345-0@lo:400:kworker.0 Request processed in 27us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869619.613908:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788869619.613918:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788869619.613924:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875765554675840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.613948:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875765554675840:12345-0@lo:400:kworker.0 Request processed in 25us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869619.613954:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788869619.613965:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788869619.613970:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554675200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.614007:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554675200:12345-0@lo:400:kworker.0 Request processed in 37us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869619.614013:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788869619.614024:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788869619.614030:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875765554675712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.614055:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875765554675712:12345-0@lo:400:kworker.0 Request processed in 26us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869619.614060:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788869619.614072:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788869619.614078:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554674944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.614109:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554674944:12345-0@lo:400:kworker.0 Request processed in 31us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869619.614114:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788869619.614138:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554675456 00000100:00100000:2.0:1788869619.614142:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554675456 00000100:00100000:2.0:1788869619.614167:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554675968 00000100:00100000:2.0:1788869619.614170:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554675968 00000100:00100000:2.0:1788869619.614183:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554675584 00000100:00100000:2.0:1788869619.614185:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554675584 00000100:00100000:2.0:1788869619.614197:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788869619.614203:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554675456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.614231:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554675456:12345-0@lo:400:kworker.0 Request processed in 28us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869619.614237:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788869619.614247:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788869619.614274:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554675968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.614312:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554675968:12345-0@lo:400:kworker.0 Request processed in 39us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869619.614317:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788869619.614328:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788869619.614334:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554675584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.614356:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554675584:12345-0@lo:400:kworker.0 Request processed in 24us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869619.614362:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788869619.614383:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554675072 00000100:00100000:2.0:1788869619.614387:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554675072 00000100:00100000:2.0:1788869619.614410:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788869619.614416:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554675072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.614446:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554675072:12345-0@lo:400:kworker.0 Request processed in 31us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869619.614452:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1788869619.614470:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869619.614473:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788869619.614475:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869619.614477:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869619.614501:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554675072:0@lo:400:kworker.0 00010000:00080000:2.0:1788869619.614514:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffac4edc00 x1875765554675584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869619.614524:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554675584:0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.614549:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554674944:0@lo:400:kworker.0 00010000:00080000:2.0:1788869619.614558:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8228d180 x1875765554675456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869619.614573:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554675456:0@lo:400:kworker.0 00010000:00080000:2.0:1788869619.614585:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82325f80 x1875765554675968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869619.614592:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554675968:0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.614634:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554675200:0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.614642:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875765554675712:0@lo:400:kworker.0 00000100:00100000:2.0:1788869619.614650:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554674816:0@lo:400:kworker.0 00010000:00080000:2.0:1788869619.614658:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8228d880 x1875765554675328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869619.614666:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554675328:0@lo:400:kworker.0 00010000:00080000:2.0:1788869619.614675:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82325500 x1875765554675840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869619.614683:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554675840:0@lo:400:kworker.0 00000100:00100000:0.0:1788869619.614823:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554674688 00000100:00100000:0.0:1788869619.614828:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554674688 00000100:00100000:0.0:1788869619.614864:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788869619.614870:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3619:x1875765554674688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869619.614909:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3619:x1875765554674688:12345-0@lo:400:kworker.0 Request processed in 39us (1575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869619.614914:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788869619.614949:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554674688:0@lo:400:kworker.0 00000100:00100000:1.0:1788869619.627595:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869619.627618:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554676096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869619.627678:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869619.627724:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554676096 00000100:00100000:1.0:1788869619.627731:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554676096 00000100:00100000:1.0:1788869619.627779:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788869619.627788:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554676096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788869619.627811:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869619.627855:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554676096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869619.627875:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:1.0:1788869619.627930:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffb9b50a80 x1875765554676096/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869635 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869619.627948:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554676096:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788869619.737417:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869620.765728:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869621.354303:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869621.354355:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869621.354387:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869621.354426:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869621.354573:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545158528 00000100:00100000:1.0:1788869621.354583:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545158528 00000100:00100000:1.0:1788869621.354634:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545158784 00000100:00100000:1.0:1788869621.354637:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545158784 00000100:00100000:3.0:1788869621.354643:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869621.354651:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545158400 00000100:00100000:1.0:1788869621.354654:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545158400 00000100:00100000:1.0:1788869621.354666:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545158656 00000100:00100000:1.0:1788869621.354668:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545158656 00000100:00100000:1.0:1788869621.354684:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 179 00000100:00100000:1.0:1788869621.354692:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545158528:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869621.354729:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545158272 00000100:00100000:2.0:1788869621.354736:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545158272 00000100:00100000:2.0:1788869621.354776:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 310 00000100:00100000:2.0:1788869621.354804:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2389:x1875765545158272:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869621.355037:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 180 00000100:00100000:0.0:1788869621.355049:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545158784:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869621.356638:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545158528:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 1938us (2274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869621.356650:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 179 00000100:00100000:1.0:1788869621.356677:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 181 00000100:00100000:1.0:1788869621.356686:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+6:2389:x1875765545158400:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869621.362064:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2389:x1875765545158272:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 7268us (7758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869621.363133:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 310 00000100:00100000:2.0:1788869621.363220:0:6484:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788869621.363229:0:6484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:2.0:1788869621.363266:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869621.363272:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869621.363282:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788869621.363293:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 182 00000100:00100000:2.0:1788869621.363306:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545158656:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869621.364201:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545158656:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 898us (9750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869621.364209:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 182 00000100:00100000:1.0:1788869621.368711:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+6:2389:x1875765545158400:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 12014us (14279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869621.368711:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545158784:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 13653us (14310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869621.368732:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 181 00000100:00100000:0.0:1788869621.369014:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 180 00000100:00100000:3.0:1788869621.656560:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554676224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869621.656627:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869621.659370:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554676224 00000100:00100000:0.0:1788869621.659382:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554676224 00000100:00100000:0.0:1788869621.659464:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788869621.659477:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554676224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788869621.659543:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869621.659623:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554676224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 149us (2994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869621.659631:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1788869621.659653:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788869621.659686:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839cc000 x1875765554676224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869621.659707:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554676224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869621.664566:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869621.664588:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554676352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869621.664652:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869621.664721:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554676352 00000100:00100000:1.0:1788869621.664728:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554676352 00000100:00100000:1.0:1788869621.664780:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788869621.664788:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554676352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869621.664811:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869621.664854:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554676352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869621.664861:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1788869621.664882:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869621.664908:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffb9b50a80 x1875765554676352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869621.664940:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554676352:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788869621.787888:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869622.184608:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869622.184633:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554676480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869622.184702:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869622.185356:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554676480 00000100:00100000:2.0:1788869622.185365:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554676480 00000100:00100000:2.0:1788869622.185575:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788869622.185586:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554676480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869622.185626:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869622.185695:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554676480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869622.185702:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788869622.196045:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554676480:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1788869622.212701:0:8393:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 85067cd6-7cd1-4166-bc53-2e9768411f07 00000020:00000080:2.0:1788869622.212711:0:8393:0:(genops.c:906:class_export_put()) final put ffff99fe81cb5800/85067cd6-7cd1-4166-bc53-2e9768411f07 00000001:00100000:2.0:1788869622.214220:0:9476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 85067cd6-7cd1-4166-bc53-2e9768411f07 00000020:00000080:2.0:1788869622.214227:0:9476:0:(genops.c:906:class_export_put()) final put ffff99ffb9b2e800/85067cd6-7cd1-4166-bc53-2e9768411f07 00000020:00000080:0.0:1788869622.217696:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe81cb5800/85067cd6-7cd1-4166-bc53-2e9768411f07 for lustre-OST0000 00000020:00000080:0.0:1788869622.217758:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffb9b2e800/85067cd6-7cd1-4166-bc53-2e9768411f07 for lustre-OST0001 00000020:00000080:0.0:1788869622.217776:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99fe81cb2800 for lustre-OST0000 00000020:00000080:0.0:1788869622.217782:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ffb9b2c800 for lustre-OST0001 00000001:02000400:2.0:1788869622.397138:0:13004:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788869622.808448:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869623.832372:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869624.217657:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554676608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869624.217726:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869624.217845:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554676608 00000100:00100000:0.0:1788869624.217852:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554676608 00000100:00100000:0.0:1788869624.217904:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788869624.217913:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554676608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788869624.217945:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788869624.217997:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554676608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869624.218004:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788869624.218047:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554676608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869624.230690:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869624.230715:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554676736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869624.230783:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869624.231076:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554676736 00000100:00100000:1.0:1788869624.231084:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554676736 00000100:00100000:1.0:1788869624.231145:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788869624.231156:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554676736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788869624.231185:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869624.231233:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554676736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869624.231240:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1788869624.231415:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788869624.231458:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839cd880 x1875765554676736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869624.231477:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554676736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869624.728994:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554676992:0@lo:400:kworker.0 00000100:00100000:0.0:1788869624.729246:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554677248:0@lo:400:kworker.0 00000100:00100000:0.0:1788869624.729365:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869624.729671:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8208aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554677760:0@lo:400:kworker.0 00000100:00100000:0.0:1788869624.729697:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869624.729725:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788869624.729732:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554676864:0@lo:400:kworker.0 00000100:00100000:0.0:1788869624.729758:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869624.729777:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554677376:0@lo:400:kworker.0 00000100:00100000:0.0:1788869624.729799:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869624.729829:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554677888:0@lo:400:kworker.0 00000100:00100000:0.0:1788869624.729851:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869624.730269:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869624.730570:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554677504:0@lo:400:kworker.0 00000100:00100000:1.0:1788869624.730595:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869624.730610:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554678016:0@lo:400:kworker.0 00000100:00100000:1.0:1788869624.730632:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869624.730650:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788869624.730656:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554677120:0@lo:400:kworker.0 00000100:00100000:1.0:1788869624.730674:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869624.730684:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554677632:0@lo:400:kworker.0 00000100:00100000:1.0:1788869624.730704:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869624.730718:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554678144:0@lo:400:kworker.0 00000100:00100000:1.0:1788869624.730736:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869624.730766:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554677376 00000100:00100000:1.0:1788869624.730773:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554677376 00000100:00100000:2.0:1788869624.730935:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554677248 00000100:00100000:2.0:1788869624.730940:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554677248 00000100:00100000:2.0:1788869624.730972:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788869624.730980:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554677248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869624.731044:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554677248:12345-0@lo:400:kworker.0 Request processed in 63us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869624.731215:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788869624.731240:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554677760 00000100:00100000:2.0:1788869624.731244:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554677760 00000100:00100000:2.0:1788869624.731571:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554677632 00000100:00100000:2.0:1788869624.731575:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554677632 00000100:00100000:2.0:1788869624.731593:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554678144 00000100:00100000:2.0:1788869624.731596:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554678144 00000100:00100000:2.0:1788869624.731612:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788869624.731618:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554677760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869624.731654:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554677760:12345-0@lo:400:kworker.0 Request processed in 36us (1956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869624.731659:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788869624.731670:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788869624.731675:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554677632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869624.731703:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554677632:12345-0@lo:400:kworker.0 Request processed in 28us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869624.731709:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788869624.731719:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788869624.731724:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554678144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869624.731749:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554678144:12345-0@lo:400:kworker.0 Request processed in 25us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869624.731755:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788869624.731772:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554676864 00000100:00100000:2.0:1788869624.731776:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554676864 00000100:00100000:2.0:1788869624.731800:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788869624.733569:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554677888 00000100:00100000:1.0:1788869624.733574:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554677888 00000100:00100000:1.0:1788869624.733598:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554676992 00000100:00100000:1.0:1788869624.733601:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554676992 00000100:00100000:1.0:1788869624.733611:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554677504 00000100:00100000:1.0:1788869624.733613:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554677504 00000100:00100000:1.0:1788869624.733623:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554678016 00000100:00100000:1.0:1788869624.733625:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554678016 00000100:00100000:1.0:1788869624.733634:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554677120 00000100:00100000:1.0:1788869624.733637:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554677120 00000100:00100000:1.0:1788869624.733652:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788869624.733659:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554677376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869624.733710:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554677376:12345-0@lo:400:kworker.0 Request processed in 51us (3909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869624.733716:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788869624.733743:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788869624.733749:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554677888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869624.733778:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554677888:12345-0@lo:400:kworker.0 Request processed in 30us (3927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869624.733784:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788869624.733795:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788869624.733801:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554676992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869624.733842:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554676992:12345-0@lo:400:kworker.0 Request processed in 42us (3573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869624.733848:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788869624.733858:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788869624.733864:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554677504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869624.733887:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554677504:12345-0@lo:400:kworker.0 Request processed in 24us (3292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869624.733989:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554676864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869624.734023:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554676864:12345-0@lo:400:kworker.0 Request processed in 39us (4265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869624.734029:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788869624.734193:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788869624.734202:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554678016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869624.734232:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554678016:12345-0@lo:400:kworker.0 Request processed in 33us (3600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869624.734238:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788869624.734250:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788869624.734274:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554677120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869624.735235:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554677120:12345-0@lo:400:kworker.0 Request processed in 960us (4557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869624.735242:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788869624.735661:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869624.735678:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554678272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869624.735715:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869624.735780:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554676864:0@lo:400:kworker.0 00000100:00100000:2.0:1788869624.735796:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554677376:0@lo:400:kworker.0 00000100:00100000:2.0:1788869624.735806:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554677888:0@lo:400:kworker.0 00000100:00100000:0.0:1788869624.736147:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554678272 00000100:00100000:0.0:1788869624.736153:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554678272 00000100:00100000:0.0:1788869624.736188:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788869624.736195:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554678272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869624.736212:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869624.736246:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554678272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869624.736271:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788869624.736615:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:1.0:1788869624.736638:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869624.736643:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869624.736645:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869624.736648:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869624.736681:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554677120:0@lo:400:kworker.0 00010000:00080000:1.0:1788869624.736697:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffb9b52d80 x1875765554677632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869624.736707:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554677632:0@lo:400:kworker.0 00010000:00080000:1.0:1788869624.736718:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffb8911180 x1875765554678144/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869624.736746:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554678144:0@lo:400:kworker.0 00000100:00100000:1.0:1788869624.736761:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554676992:0@lo:400:kworker.0 00010000:00080000:1.0:1788869624.736771:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffb9b52a00 x1875765554677504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869624.736779:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554677504:0@lo:400:kworker.0 00010000:00080000:1.0:1788869624.736789:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffb8912680 x1875765554678016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869624.736797:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554678016:0@lo:400:kworker.0 00000100:00100000:2.0:1788869624.737237:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554677248:0@lo:400:kworker.0 00010000:00080000:2.0:1788869624.737274:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8208aa00 x1875765554677760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869624.738205:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8208aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554677760:0@lo:400:kworker.0 00010000:00080000:2.0:1788869624.738271:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffae6aea00 x1875765554678272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869624.739197:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554678272:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788869624.857238:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869625.880458:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869626.471882:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869626.471929:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869626.471962:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869626.471992:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869626.472020:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869626.472047:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545159168 00000100:00100000:3.0:1788869626.472071:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545159168 00000100:00100000:3.0:1788869626.472124:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545159424 00000100:00100000:3.0:1788869626.472128:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545159424 00000100:00100000:3.0:1788869626.472144:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545159040 00000100:00100000:3.0:1788869626.472147:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545159040 00000100:00100000:3.0:1788869626.472158:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545159296 00000100:00100000:3.0:1788869626.472160:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545159296 00000100:00100000:3.0:1788869626.472176:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 189 00000100:00100000:3.0:1788869626.472185:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545159168:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869626.472357:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 190 00000100:00100000:0.0:1788869626.472367:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545159424:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869626.472444:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545158912 00000100:00100000:2.0:1788869626.472448:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545158912 00000100:00100000:1.0:1788869626.472477:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 191 00000100:00100000:1.0:1788869626.472487:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:2390:x1875765545159040:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869626.472488:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 312 00000100:00100000:2.0:1788869626.472494:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8a775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2390:x1875765545158912:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869626.472559:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545159168:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 374us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869626.472566:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 189 00000100:00100000:3.0:1788869626.472584:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 192 00000100:00100000:3.0:1788869626.472591:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545159296:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869626.472689:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545159424:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 323us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869626.472697:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 190 00000100:00080000:0.0:1788869626.473641:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869626.473657:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869626.475671:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8a775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2390:x1875765545158912:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 3166us (3788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869626.475684:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 312 00000100:00100000:1.0:1788869626.476185:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:2390:x1875765545159040:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 3697us (4189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869626.476196:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 191 00000100:00100000:1.0:1788869626.478965:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545159296:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 6362us (6931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869626.478979:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 192 00000100:00100000:0.0:1788869626.776480:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554678400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869626.776553:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869626.776628:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554678400 00000100:00100000:0.0:1788869626.776636:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554678400 00000100:00100000:0.0:1788869626.776689:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788869626.776698:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554678400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788869626.776734:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869626.776780:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554678400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869626.776790:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1788869626.776814:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788869626.776845:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffae6af800 x1875765554678400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869626.776864:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554678400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869626.777234:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554678528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869626.777291:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869626.777417:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554678528 00000100:00100000:0.0:1788869626.777421:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554678528 00000100:00100000:0.0:1788869626.777474:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788869626.777480:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554678528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869626.777491:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869626.777521:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554678528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869626.777526:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1788869626.777611:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788869626.777631:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffae6af800 x1875765554678528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869626.777643:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554678528:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788869626.915191:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788869626.947556:0:13151:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffcff82d10 20000000:00000080:0.0:1788869626.947573:0:13151:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99fe81f49000 uarg=0000000000000000 20000000:01000000:0.0:1788869626.947615:0:13151:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788869626.947621:0:13151:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788869626.947630:0:13151:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788869626.955750:0:13152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788869626.959027:0:13151:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788869626.970166:0:13151:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788869626.970836:0:13151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d2a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.970857:0:13151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb98e2a00/0xbead52e175fc2cba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa919 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.970865:0:13151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2cc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2cc1 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.970871:0:13151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb95a8400/0xbead52e175fc2cd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2ccf expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.970877:0:13151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb9a9f600/0xbead52e175fc2ce4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2cdd expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.970902:0:13151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb95a9400/0xbead52e175fc2cf2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2ceb expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.970908:0:13151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb98e3a00/0xbead52e175fc2d07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa958 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.970915:0:13151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d2a lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.970970:0:13151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb98e3a00/0xbead52e175fc2d07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa958 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.970983:0:13151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffb98e3a00/0xbead52e175fc2d07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa958 expref: 12 pid: 6479 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869626.970997:0:13151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf983480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875765554678656:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788869626.971100:0:13151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb95a9400/0xbead52e175fc2cf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2ceb expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.971109:0:13151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffb95a9400/0xbead52e175fc2cf2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2ceb expref: 23 pid: 6476 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869626.971118:0:13151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf983b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875765554678784:0@lo:104: 00000100:00100000:2.0:1788869626.971156:0:13151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869626.971236:0:13151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb9a9f600/0xbead52e175fc2ce4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2cdd expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.971244:0:13151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffb9a9f600/0xbead52e175fc2ce4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2cdd expref: 23 pid: 6476 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869626.971289:0:13151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf981500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875765554678912:0@lo:104: 00000100:00100000:2.0:1788869626.971311:0:13151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869626.974280:0:13151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb95a8400/0xbead52e175fc2cd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2ccf expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.974297:0:13151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffb95a8400/0xbead52e175fc2cd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2ccf expref: 23 pid: 6479 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869626.974310:0:13151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b52a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875765554679040:0@lo:104: 00000100:00100000:2.0:1788869626.974357:0:13151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869626.974484:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554678784 00000100:00100000:1.0:1788869626.974493:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554678784 00000100:00100000:1.0:1788869626.974533:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554678912 00000100:00100000:1.0:1788869626.974537:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554678912 00000100:00100000:1.0:1788869626.974550:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788869626.974559:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf983100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+4:13151:x1875765554678784:12345-0@lo:104: 00010000:00010000:1.0:1788869626.974573:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc2ceb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2cf2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869626.974837:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788869626.974844:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf983100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+4:13151:x1875765554678784:12345-0@lo:104: Request processed in 286us (3688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869626.974851:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788869626.974869:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788869626.974874:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8208aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+3:13151:x1875765554678912:12345-0@lo:104: 00010000:00010000:1.0:1788869626.974882:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2200/0xbead52e175fc2cdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2ce4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869626.974916:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788869626.974928:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8208aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+3:13151:x1875765554678912:12345-0@lo:104: Request processed in 48us (3610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869626.974933:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:1.0:1788869626.974951:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788869626.974956:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc2ceb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2cf2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869626.974964:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fe00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1788869626.974967:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc2ceb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2cf2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869626.974990:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc2ceb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2cf2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869626.974997:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc2ceb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2cf2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869626.975002:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1788869626.975004:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788869626.975010:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2200/0xbead52e175fc2cdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2ce4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.975073:0:13151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2cc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2cc1 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.975082:0:13151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2cc8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2cc1 expref: 23 pid: 6478 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869626.975090:0:13151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b52d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875765554679168:0@lo:104: 00000100:00100000:2.0:1788869626.975119:0:13151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869626.975140:0:13151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb98e2a00/0xbead52e175fc2cba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa919 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.975150:0:13151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffb98e2a00/0xbead52e175fc2cba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa919 expref: 12 pid: 6479 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869626.975160:0:13151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b50000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875765554679296:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788869626.975205:0:13151:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788869626.975226:0:13151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf983b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875765554678784:0@lo:104: 00000100:00100000:2.0:1788869626.975245:0:13151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf981500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875765554678912:0@lo:104: 00010000:00010000:3.0:1788869626.979783:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb98e2200 already unused, calling callback (ffffffffc11c1c20) 00010000:00010000:1.0:1788869626.979785:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc2ceb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2cf2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869626.979798:0:7425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2200/0xbead52e175fc2cdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2ce4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869626.979801:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869626.979813:0:7425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2200/0xbead52e175fc2cdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2ce4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869626.979823:0:7425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2200/0xbead52e175fc2cdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2ce4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869626.979851:0:7425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788869626.979892:0:7425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2200/0xbead52e175fc2cdd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2ce4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869626.979898:0:7425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788869626.979910:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554679424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869626.979973:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788869626.980038:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc2ceb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2cf2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869626.980048:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc2ceb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2cf2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869626.980188:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554679040 00000100:00100000:1.0:1788869626.980195:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554679040 00000100:00100000:1.0:1788869626.980227:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554679168 00000100:00100000:1.0:1788869626.980229:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554679168 00000100:00100000:1.0:1788869626.980241:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788869626.980248:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+4:13151:x1875765554679040:12345-0@lo:104: 00010000:00010000:1.0:1788869626.980276:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2ccf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2cd6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869626.980331:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788869626.980337:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+4:13151:x1875765554679040:12345-0@lo:104: Request processed in 89us (5980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869626.980352:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788869626.980370:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788869626.980376:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+3:13151:x1875765554679168:12345-0@lo:104: 00010000:00010000:1.0:1788869626.980384:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8a00/0xbead52e175fc2cc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2cc8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869626.980413:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788869626.980418:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+3:13151:x1875765554679168:12345-0@lo:104: Request processed in 43us (5299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869626.980424:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1788869626.980439:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788869626.980444:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2ccf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2cd6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869626.980451:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a8800 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1788869626.980468:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2ccf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2cd6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869626.980475:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2ccf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2cd6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869626.980482:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2ccf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2cd6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869626.980487:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788869626.980508:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2ccf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2cd6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869626.980514:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869626.980533:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2ccf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2cd6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869626.980539:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc2ccf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2cd6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869626.980550:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869626.980553:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8a00/0xbead52e175fc2cc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2cc8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869626.980559:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a8a00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1788869626.980562:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8a00/0xbead52e175fc2cc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2cc8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869626.980569:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8a00/0xbead52e175fc2cc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2cc8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869626.980574:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8a00/0xbead52e175fc2cc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2cc8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869626.980579:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788869626.980592:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8a00/0xbead52e175fc2cc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2cc8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869626.980598:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788869626.981005:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869626.981016:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554679808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869626.981046:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869626.981094:0:13151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b52a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875765554679040:0@lo:104: 00000100:00100000:2.0:1788869626.981105:0:13151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b52d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875765554679168:0@lo:104: 00010000:00010000:1.0:1788869626.981209:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8a00/0xbead52e175fc2cc1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2cc8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869626.981217:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8a00/0xbead52e175fc2cc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2cc8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869626.981228:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869626.981235:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869626.981237:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869626.981313:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869626.981316:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869626.981317:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869626.982800:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554679424 00000100:00100000:1.0:1788869626.982811:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554679424 00010000:00010000:1.0:1788869626.982850:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb95a9400/0xbead52e175fc2cf2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2ceb expref: 24 pid: 6476 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869626.982934:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554679808 00000100:00100000:1.0:1788869626.982939:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554679808 00010000:00010000:1.0:1788869626.982952:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2cc8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2cc1 expref: 25 pid: 6478 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869626.983099:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2200/0xbead52e175fc2cdd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2ce4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869626.983110:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2200/0xbead52e175fc2cdd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2ce4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869626.983679:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788869626.983694:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46892796-b77d-4866-a7cc-ce4160dea4be+25:3617:x1875765554679424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869626.983716:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869626.983723:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb95a9400/0xbead52e175fc2cf2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2ceb expref: 25 pid: 6476 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.983735:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb95a9400/0xbead52e175fc2cf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2ceb expref: 25 pid: 6476 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.983753:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb95a9400/0xbead52e175fc2cf2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2ceb expref: 25 pid: 6476 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.983767:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869626.983834:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554679424:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (3861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869626.983842:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788869626.983861:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788869626.983867:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46892796-b77d-4866-a7cc-ce4160dea4be+23:3617:x1875765554679808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869626.983898:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869626.983903:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2cc8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2cc1 expref: 23 pid: 6478 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.983912:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2cc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2cc1 expref: 23 pid: 6478 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.983922:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2cc8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2cc1 expref: 23 pid: 6478 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.983932:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869626.983956:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46892796-b77d-4866-a7cc-ce4160dea4be+22:3617:x1875765554679808:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (2909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869626.983962:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1788869626.983980:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869626.983982:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869626.983984:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869626.984112:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554679552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869626.984128:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554679808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869626.984143:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554679424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869626.984153:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869626.984217:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869626.984223:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554679680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869626.984241:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869626.984333:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554679552 00000100:00100000:2.0:1788869626.984338:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554679552 00010000:00010000:2.0:1788869626.984355:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb9a9f600/0xbead52e175fc2ce4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2cdd expref: 22 pid: 6476 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869626.984402:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554679680 00000100:00100000:2.0:1788869626.984406:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554679680 00010000:00010000:2.0:1788869626.984417:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb95a8400/0xbead52e175fc2cd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2ccf expref: 23 pid: 6479 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869626.984446:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788869626.984463:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83087100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+23:3618:x1875765554679552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869626.984471:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869626.984476:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb9a9f600/0xbead52e175fc2ce4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2cdd expref: 23 pid: 6476 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869626.984484:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb9a9f600/0xbead52e175fc2ce4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2cdd expref: 23 pid: 6476 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869626.984494:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb9a9f600/0xbead52e175fc2ce4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2cdd expref: 23 pid: 6476 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869626.984513:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869626.984543:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83087100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+22:3618:x1875765554679552:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869626.984549:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788869626.984564:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788869626.984569:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+21:3618:x1875765554679680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869626.984577:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869626.984581:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb95a8400/0xbead52e175fc2cd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2ccf expref: 21 pid: 6479 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869626.984736:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869626.984756:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545159552 00000100:00100000:3.0:1788869626.984760:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545159552 00010000:00010000:3.0:1788869626.984778:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb98e3a00/0xbead52e175fc2d07 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa958 expref: 13 pid: 6479 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869626.984793:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:3.0:1788869626.984800:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8911180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2388:x1875765545159552:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869626.984809:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869626.984811:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb95a8400/0xbead52e175fc2cd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2ccf expref: 21 pid: 6479 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869626.984814:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb98e3a00/0xbead52e175fc2d07 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa958 expref: 13 pid: 6479 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869626.984835:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb95a8400/0xbead52e175fc2cd6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2ccf expref: 21 pid: 6479 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869626.984844:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb98e3a00/0xbead52e175fc2d07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa958 expref: 13 pid: 6479 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869626.984887:0:13151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf983480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875765554678656:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788869626.984916:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869626.984941:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46892796-b77d-4866-a7cc-ce4160dea4be+20:3618:x1875765554679680:12345-0@lo:103:ldlm_bl.0 Request processed in 372us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869626.984948:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788869626.984972:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554679680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869626.984980:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554679552:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788869626.991115:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb98e3a00/0xbead52e175fc2d07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa958 expref: 13 pid: 6479 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869626.991145:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869626.991423:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8911180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:2388:x1875765545159552:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 6621us (6686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869626.991466:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:3.0:1788869626.992049:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869626.992079:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545159680 00000100:00100000:3.0:1788869626.992089:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545159680 00010000:00010000:3.0:1788869626.992120:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb98e2a00/0xbead52e175fc2cba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa919 expref: 12 pid: 6479 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869626.992146:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:3.0:1788869626.992154:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89daa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:2388:x1875765545159680:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869626.992167:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869626.992174:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb98e2a00/0xbead52e175fc2cba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa919 expref: 12 pid: 6479 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869626.992185:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb98e2a00/0xbead52e175fc2cba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa919 expref: 12 pid: 6479 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869626.992200:0:9488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d2a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869626.992208:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d2a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869626.992222:0:9488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d2a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869626.992228:0:9488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d2a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869626.992242:0:9488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d2a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869626.992249:0:9488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d2a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869626.992281:0:9488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535400 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869626.992285:0:9488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d2a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869626.992292:0:9488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d2a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869626.992300:0:9488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d2a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869626.992310:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869626.992338:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89daa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:2388:x1875765545159680:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 185us (290us total) trans 0 rc 0/0 00010000:00010000:2.0:1788869626.993024:0:13151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb98e2a00/0xbead52e175fc2cba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa919 expref: 12 pid: 6479 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869626.993041:0:13151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b50000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875765554679296:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788869626.993074:0:13151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d2a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.993082:0:13151:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d2a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.993088:0:13151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d2a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869626.993094:0:13151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d2a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869626.994539:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:0.0:1788869627.301667:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554679936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869627.301734:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869627.301804:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554679936 00000100:00100000:0.0:1788869627.301811:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554679936 00000100:00100000:0.0:1788869627.301854:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788869627.301864:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554679936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869627.301897:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788869627.301957:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554679936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869627.301964:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788869627.302003:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554679936:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788869627.929110:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788869628.249378:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788869628.249386:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ffb9bbc800 from 7 10000000:01000000:1.0:1788869628.249391:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869628.249465:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8400/0xbead52e175fc2d31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869628.249486:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8400/0xbead52e175fc2d31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869628.249497:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8400/0xbead52e175fc2d31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869628.249522:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83087800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554680064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869628.249589:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869628.249633:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff885fa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869628.249919:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554680064 00000100:00100000:2.0:1788869628.249927:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554680064 00000100:00100000:2.0:1788869628.249998:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788869628.250017:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8a777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+20:6481:x1875765554680064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869628.250030:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869628.250044:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2d31 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869628.250066:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2d31 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869628.250076:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2d31 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869628.250092:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81535400, rc 0) 00000100:00100000:2.0:1788869628.250139:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8a777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554680064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869628.250146:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788869628.250581:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83087800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554680064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869628.250597:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8400/0xbead52e175fc2d31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2d38 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869628.250606:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8400/0xbead52e175fc2d31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2d38 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869628.250663:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83087800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554680192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869628.250691:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869628.250713:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff885fa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869628.250755:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554680192 00000100:00100000:2.0:1788869628.250760:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554680192 00000100:00100000:2.0:1788869628.250791:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788869628.250798:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8a775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554680192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869628.250911:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8a775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554680192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869628.250919:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788869628.250944:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83087800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554680192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869628.250968:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554680320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869628.251002:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869628.251080:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869628.251092:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554680320 00000100:00100000:2.0:1788869628.251095:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554680320 00000100:00100000:2.0:1788869628.251109:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788869628.251114:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff994d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554680320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869628.251180:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff994d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554680320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869628.251186:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788869628.251216:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554680320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788869628.254199:0:13176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788869628.254649:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788869628.254673:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788869628.254684:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8400/0xbead52e175fc2d31 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2d38 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869628.254696:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8400/0xbead52e175fc2d31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2d38 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869628.254706:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788869628.254708:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ffc10cf800 from 7 10000000:01000000:0.0:1788869628.254711:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788869628.254745:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2d3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869628.254754:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2d3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869628.254777:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2d3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869628.254802:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554680448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869628.254861:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869628.254903:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff9553dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869628.257858:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554680448 00000100:00100000:2.0:1788869628.257872:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554680448 00000100:00100000:2.0:1788869628.257931:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788869628.257941:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8d0e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554680448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869628.257958:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869628.257976:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2d46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2d3f expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869628.258002:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2d46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2d3f expref: 22 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869628.258013:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2d46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2d3f expref: 22 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869628.258021:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534a00, rc 0) 00000100:00100000:2.0:1788869628.258097:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8d0e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554680448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (3235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869628.258104:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788869628.259277:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554680448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869628.259298:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2d3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2d46 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869628.259310:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2d3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2d46 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869628.259390:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554680576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869628.259698:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869628.259728:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff9553dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869628.260220:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554680576 00000100:00100000:3.0:1788869628.260226:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554680576 00000100:00100000:3.0:1788869628.260305:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788869628.260314:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554680576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869628.260470:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554680576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869628.260478:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788869628.260516:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554680576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869628.260565:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8911180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554680704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869628.260601:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869628.260614:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8862fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869628.260627:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554680704 00000100:00100000:3.0:1788869628.260630:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554680704 00000100:00100000:3.0:1788869628.260651:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788869628.260657:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554680704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869628.260729:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554680704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869628.260736:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788869628.260768:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8911180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554680704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788869628.262294:0:13177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788869628.262610:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788869628.262646:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788869628.262657:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2d3f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2d46 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869628.262669:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2d3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2d46 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869628.262679:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788869628.262682:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ff89980800 from 7 10000000:01000000:2.0:1788869628.262685:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788869628.262713:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81535200/0xbead52e175fc2d4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869628.262732:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ff81535200/0xbead52e175fc2d4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869628.262742:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ff81535200/0xbead52e175fc2d4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869628.262764:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554680832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869628.262814:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869628.262845:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869628.262960:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554680832 00000100:00100000:3.0:1788869628.262966:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554680832 00000100:00100000:3.0:1788869628.263105:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788869628.263118:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554680832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869628.263130:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869628.263143:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2d54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2d4d expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869628.263166:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2d54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2d4d expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869628.263175:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2d54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2d4d expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869628.263183:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9e800, rc 0) 00000100:00100000:3.0:1788869628.263229:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554680832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869628.263271:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788869628.263361:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554680832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869628.263375:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ff81535200/0xbead52e175fc2d4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2d54 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869628.263384:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ff81535200/0xbead52e175fc2d4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2d54 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869628.263668:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554680960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869628.263696:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869628.263728:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869628.267715:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554680960 00000100:00100000:0.0:1788869628.267727:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554680960 00000100:00100000:0.0:1788869628.267786:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788869628.267797:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554680960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869628.267958:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554680960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (4261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869628.267966:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788869628.267991:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554680960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869628.268282:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554681088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869628.268337:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869628.268369:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869628.268626:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554681088 00000100:00100000:3.0:1788869628.268633:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554681088 00000100:00100000:3.0:1788869628.268669:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788869628.268677:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554681088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869628.268765:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554681088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869628.268772:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788869628.268906:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554681088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788869628.270105:0:13178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788869628.270282:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788869628.270364:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788869628.270374:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81535200/0xbead52e175fc2d4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2d54 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869628.270385:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ff81535200/0xbead52e175fc2d4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2d54 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869628.270395:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788869628.270410:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ff8b15e800 from 7 10000000:01000000:3.0:1788869628.270413:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788869628.270791:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81535a00/0xbead52e175fc2d5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869628.270800:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ff81535a00/0xbead52e175fc2d5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869628.270809:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ff81535a00/0xbead52e175fc2d5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869628.270829:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8911180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554681216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869628.270884:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869628.270966:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869628.270998:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554681216 00000100:00100000:0.0:1788869628.271005:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554681216 00000100:00100000:0.0:1788869628.271144:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788869628.271162:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554681216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869628.271174:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869628.271188:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb98e2200/0xbead52e175fc2d62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2d5b expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869628.271209:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb98e2200/0xbead52e175fc2d62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2d5b expref: 24 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869628.271218:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb98e2200/0xbead52e175fc2d62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2d5b expref: 24 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869628.271225:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb98e2200, rc 0) 00000100:00100000:0.0:1788869628.271685:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554681216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 524us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869628.271693:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788869628.271761:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8911180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554681216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869628.271775:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ff81535a00/0xbead52e175fc2d5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2d62 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869628.271784:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ff81535a00/0xbead52e175fc2d5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2d62 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869628.271838:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554681344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869628.271864:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869628.271923:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869628.271954:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554681344 00000100:00100000:3.0:1788869628.271958:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554681344 00000100:00100000:3.0:1788869628.272028:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788869628.272035:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554681344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869628.272150:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554681344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869628.272156:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788869628.272217:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554681344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869628.272296:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554681472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869628.272331:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869628.272960:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff9553d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869628.272996:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554681472 00000100:00100000:2.0:1788869628.273002:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554681472 00000100:00100000:2.0:1788869628.273039:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788869628.273047:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554681472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869628.273135:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554681472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869628.273152:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788869628.273724:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554681472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788869628.274880:0:13179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788869628.276388:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788869628.276448:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788869628.276460:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81535a00/0xbead52e175fc2d5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2d62 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869628.276473:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ff81535a00/0xbead52e175fc2d5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2d62 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869628.774687:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869628.774789:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545159808 00000100:00100000:0.0:1788869628.774803:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545159808 00000100:00100000:0.0:1788869628.774862:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 325 00000100:00100000:0.0:1788869628.774874:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+11:6155:x1875765545159808:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869628.774889:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869628.774906:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb98e3200/0xbead52e175fc2d69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa989 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869628.774933:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb98e3200/0xbead52e175fc2d69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa989 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869628.774945:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb98e3200/0xbead52e175fc2d69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa989 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869628.774954:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb98e3200, rc 0) 00000100:00100000:0.0:1788869628.775401:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:6155:x1875765545159808:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 528us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869628.775409:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 325 00000100:00100000:3.0:1788869628.778190:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869628.778385:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545159936 00000100:00100000:0.0:1788869628.778397:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545159936 00000100:00100000:0.0:1788869628.778506:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 326 00000100:00100000:0.0:1788869628.778518:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:6155:x1875765545159936:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869628.778817:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:6155:x1875765545159936:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 300us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869628.778827:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 326 00000100:00100000:2.0:1788869628.789161:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869628.790348:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545160064 00000100:00100000:1.0:1788869628.790363:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545160064 00000100:00100000:1.0:1788869628.790428:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 327 00000100:00100000:1.0:1788869628.790447:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:6155:x1875765545160064:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869628.794491:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:6155:x1875765545160064:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 4041us (5331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869628.794507:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 327 00000100:00100000:3.0:1788869628.853826:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869628.866878:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545160192 00000100:00100000:0.0:1788869628.866903:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545160192 00000100:00100000:1.0:1788869628.870371:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 328 00000100:00100000:1.0:1788869628.870385:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:6155:x1875765545160192:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869628.870402:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869628.870419:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb95a8800/0xbead52e175fc2d70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa990 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869628.870463:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb95a8800/0xbead52e175fc2d70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa990 expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869628.870475:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb95a8800/0xbead52e175fc2d70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa990 expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869628.870485:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a8800, rc 0) 00000100:00100000:1.0:1788869628.870554:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:6155:x1875765545160192:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 173us (16844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869628.870561:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 328 00000100:00100000:3.0:1788869628.876129:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869628.878852:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545160320 00000100:00100000:1.0:1788869628.878866:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545160320 00000100:00100000:1.0:1788869628.878943:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 329 00000100:00100000:1.0:1788869628.878955:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:6155:x1875765545160320:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869628.882388:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:6155:x1875765545160320:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 3423us (6255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869628.882404:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 329 00000100:00100000:0.0:1788869628.912057:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869628.912828:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545160448 00000100:00100000:3.0:1788869628.912838:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545160448 00000100:00100000:3.0:1788869628.912908:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 330 00000100:00100000:3.0:1788869628.912918:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:6155:x1875765545160448:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869628.913109:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:6155:x1875765545160448:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 191us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869628.913118:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 330 00010000:00010000:1.0:1788869628.952426:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869629.355677:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554681600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869629.356444:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869629.357040:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554681600 00000100:00100000:0.0:1788869629.357048:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554681600 00000100:00080000:1.0:1788869629.357095:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869629.357143:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788869629.357152:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554681600:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869629.357173:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00002000:00000024:0.0:1788869629.357182:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869629.357183:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554681728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869629.357221:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554681600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869629.357229:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788869629.357232:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788869629.357351:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83084a80 x1875765554681600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869645 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869629.357380:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554681600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869629.357402:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554681728 00000100:00100000:2.0:1788869629.357405:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554681728 00000100:00100000:2.0:1788869629.357449:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788869629.357456:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554681728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869629.357477:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788869629.357511:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554681728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869629.357516:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788869629.357541:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554681728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869629.848861:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554681856:0@lo:400:kworker.0 00000100:00100000:0.0:1788869629.848898:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875765554681984:0@lo:400:kworker.0 00000100:00100000:0.0:1788869629.857023:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869629.857098:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554682496:0@lo:400:kworker.0 00000100:00100000:0.0:1788869629.857148:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869629.857163:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554683008:0@lo:400:kworker.0 00000100:00100000:0.0:1788869629.857179:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869629.857206:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788869629.857212:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875765554682368:0@lo:400:kworker.0 00000100:00100000:0.0:1788869629.857232:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869629.857277:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1875765554682880:0@lo:400:kworker.0 00000100:00100000:1.0:1788869629.858135:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869629.858207:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554682240:0@lo:400:kworker.0 00000100:00100000:1.0:1788869629.858246:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869629.858289:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554682752:0@lo:400:kworker.0 00000100:00100000:1.0:1788869629.858314:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869629.858334:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788869629.858341:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875765554682112:0@lo:400:kworker.0 00000100:00100000:1.0:1788869629.858370:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554681984 00000100:00100000:1.0:1788869629.858378:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554681984 00000100:00100000:1.0:1788869629.858418:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554682496 00000100:00100000:1.0:1788869629.858422:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554682496 00000100:00100000:1.0:1788869629.858454:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554683008 00000100:00100000:1.0:1788869629.858457:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554683008 00000100:00100000:1.0:1788869629.858468:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554682368 00000100:00100000:1.0:1788869629.858470:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554682368 00000100:00100000:1.0:1788869629.858484:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788869629.858492:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875765554681984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869629.858541:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875765554681984:12345-0@lo:400:kworker.0 Request processed in 49us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869629.858548:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788869629.858563:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788869629.858569:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554682496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869629.858594:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554682496:12345-0@lo:400:kworker.0 Request processed in 26us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869629.858599:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788869629.858610:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788869629.858616:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875765554683008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869629.858641:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875765554683008:12345-0@lo:400:kworker.0 Request processed in 26us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869629.858653:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788869629.858665:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788869629.858671:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf95b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875765554682368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869629.858699:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf95b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875765554682368:12345-0@lo:400:kworker.0 Request processed in 28us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869629.858704:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788869629.858720:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554682752 00000100:00100000:1.0:1788869629.858724:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554682752 00000100:00100000:1.0:1788869629.858748:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788869629.858754:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554682752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869629.858784:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554682752:12345-0@lo:400:kworker.0 Request processed in 30us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869629.858789:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1788869629.858805:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869629.858809:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869629.858811:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869629.859071:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554681856 00000100:00100000:3.0:1788869629.859076:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554681856 00000100:00100000:3.0:1788869629.859127:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788869629.859135:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3616:x1875765554681856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869629.859172:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3616:x1875765554681856:12345-0@lo:400:kworker.0 Request processed in 38us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869629.859179:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788869629.859311:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554682240 00000100:00100000:3.0:1788869629.859316:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554682240 00000100:00100000:3.0:1788869629.859343:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788869629.859350:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554682240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869629.859406:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554681856:0@lo:400:kworker.0 00000100:00100000:3.0:1788869629.859532:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554682240:12345-0@lo:400:kworker.0 Request processed in 182us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869629.859538:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788869629.859765:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869629.859777:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554683264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869629.859817:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869629.859909:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554683264 00000100:00100000:1.0:1788869629.859914:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554683264 00000100:00100000:1.0:1788869629.859982:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788869629.859988:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554683264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788869629.860003:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869629.860038:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554683264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869629.860044:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:1.0:1788869629.860072:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffb8913800 x1875765554683264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869645 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869629.860094:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554683264:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788869629.860135:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869629.860500:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869629.860552:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875765554681984:0@lo:400:kworker.0 00010000:00080000:0.0:1788869629.860564:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82229880 x1875765554682496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869629.860573:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554682496:0@lo:400:kworker.0 00010000:00080000:0.0:1788869629.860592:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82229500 x1875765554683008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869629.860601:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554683008:0@lo:400:kworker.0 00000100:00100000:0.0:1788869629.860620:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875765554682368:0@lo:400:kworker.0 00000100:00100000:1.0:1788869629.860844:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554682880 00000100:00100000:1.0:1788869629.860849:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554682880 00000100:00100000:1.0:1788869629.860895:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788869629.860901:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf95ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875765554682880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869629.860945:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf95ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875765554682880:12345-0@lo:400:kworker.0 Request processed in 43us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869629.860951:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788869629.860965:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869629.860985:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554682112 00000100:00100000:3.0:1788869629.860988:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554682624:0@lo:400:kworker.0 00000100:00100000:1.0:1788869629.860988:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554682112 00000100:00100000:1.0:1788869629.861009:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788869629.861015:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875765554682112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869629.861016:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869629.861035:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554683136:0@lo:400:kworker.0 00000100:00100000:1.0:1788869629.861042:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875765554682112:12345-0@lo:400:kworker.0 Request processed in 28us (77us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869629.861048:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788869629.861053:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869629.861078:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554682240:0@lo:400:kworker.0 00010000:00080000:3.0:1788869629.861090:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8222aa00 x1875765554682752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869629.861098:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554682752:0@lo:400:kworker.0 00000100:00100000:3.0:1788869629.861114:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875765554682112:0@lo:400:kworker.0 00000100:00100000:3.0:1788869629.861132:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554682624 00000100:00100000:3.0:1788869629.861135:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554682624 00000100:00100000:3.0:1788869629.861169:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554683136 00000100:00100000:3.0:1788869629.861172:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554683136 00000100:00100000:3.0:1788869629.861193:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788869629.861198:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788869629.861199:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554682624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869629.861204:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554683136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869629.861390:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554682624:12345-0@lo:400:kworker.0 Request processed in 191us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869629.861397:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:3.0:1788869629.861611:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82229c00 x1875765554682624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869629.861621:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554682624:0@lo:400:kworker.0 00010000:00080000:3.0:1788869629.861630:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8222b800 x1875765554683136/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869629.861643:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554683136:0@lo:400:kworker.0 00000100:00100000:1.0:1788869629.862200:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554683136:12345-0@lo:400:kworker.0 Request processed in 994us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869629.862207:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1788869629.862491:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788869629.862497:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869629.862522:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1875765554682880:0@lo:400:kworker.0 00010000:00010000:2.0:1788869629.976405:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788869630.892551:0:13350:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788869631.003287:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869631.593230:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869631.593316:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869631.593401:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869631.593494:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545160576 00000100:00100000:1.0:1788869631.593510:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545160576 00000100:00100000:1.0:1788869631.593610:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 332 00000100:00100000:1.0:1788869631.593623:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2389:x1875765545160576:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869631.593736:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2389:x1875765545160576:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 115us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869631.593766:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 332 00000100:00100000:0.0:1788869631.605923:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869631.610186:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545160832 00000100:00100000:3.0:1788869631.610206:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545160832 00000100:00080000:2.0:1788869631.610837:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869631.610950:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545161088 00000100:00100000:3.0:1788869631.610955:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545161088 00000100:00100000:3.0:1788869631.611007:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 199 00000100:00100000:3.0:1788869631.611018:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545160832:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869631.611118:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545160832:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 102us (17801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869631.611125:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 199 00000100:00100000:3.0:1788869631.611146:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 200 00000100:00100000:3.0:1788869631.611153:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545161088:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869631.611173:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545161088:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (17772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869631.611179:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 200 00000100:00080000:3.0:1788869631.611368:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869631.617058:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869631.620740:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545160704 00000100:00100000:1.0:1788869631.620765:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545160704 00000100:00080000:0.0:1788869631.620946:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869631.623298:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545160960 00000100:00100000:2.0:1788869631.623350:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545160960 00000100:00100000:2.0:1788869631.623460:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 201 00000100:00100000:2.0:1788869631.623474:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf95b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2389:x1875765545160704:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869631.624223:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf95b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2389:x1875765545160704:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 749us (18310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869631.624233:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 201 00000100:00100000:2.0:1788869631.624281:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 202 00000100:00100000:2.0:1788869631.624290:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf95bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545160960:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869631.624321:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf95bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545160960:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 34us (7283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869631.624338:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 202 00000100:00080000:0.0:1788869631.624867:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869631.896656:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869631.896687:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554683392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869631.896782:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869631.896879:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554683392 00000100:00100000:0.0:1788869631.896888:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554683392 00000100:00100000:0.0:1788869631.896966:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788869631.896977:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554683392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869631.897012:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869631.897059:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554683392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869631.897066:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1788869631.897111:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788869631.897159:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf958700 x1875765554683392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869647 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869631.897180:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554683392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869631.897380:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554683520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869631.897419:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869631.897500:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554683520 00000100:00100000:1.0:1788869631.897505:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554683520 00000100:00100000:1.0:1788869631.897547:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788869631.897554:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554683520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869631.897567:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869631.897601:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554683520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869631.897608:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1788869631.897966:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788869631.897990:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83086680 x1875765554683520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869647 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869631.898007:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554683520:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788869632.024880:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869632.410943:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869632.413511:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554683648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869632.413625:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869632.438639:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554683648 00000100:00100000:2.0:1788869632.438660:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554683648 00000100:00100000:2.0:1788869632.438750:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788869632.438764:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554683648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869632.438816:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869632.515970:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554683648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77194us (102328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869632.515992:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788869632.516379:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554683648:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788869633.049617:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869634.072662:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869634.456856:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554683776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869634.456946:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869634.457136:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554683776 00000100:00100000:2.0:1788869634.457146:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554683776 00000100:00100000:2.0:1788869634.457201:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788869634.457211:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554683776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869634.457274:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788869634.457326:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554683776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869634.457346:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788869634.458185:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554683776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869634.458518:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869634.458531:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554683904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869634.458574:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869634.459769:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554683904 00000100:00100000:1.0:1788869634.459778:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554683904 00000100:00100000:1.0:1788869634.459855:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788869634.459867:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554683904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788869634.459895:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869634.459965:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554683904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869634.459972:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:1.0:1788869634.460007:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83084380 x1875765554683904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869650 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869634.460024:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554683904:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788869634.460825:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869634.969936:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554684416:0@lo:400:kworker.0 00000100:00100000:2.0:1788869634.970005:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869634.970070:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554684928:0@lo:400:kworker.0 00000100:00100000:2.0:1788869634.970094:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869634.970122:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788869634.970128:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554684032:0@lo:400:kworker.0 00000100:00100000:2.0:1788869634.970158:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869634.970191:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875765554684544:0@lo:400:kworker.0 00000100:00100000:2.0:1788869634.970217:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869634.970236:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875765554685056:0@lo:400:kworker.0 00000100:00100000:2.0:1788869634.970306:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869634.970337:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554684928 00000100:00100000:2.0:1788869634.970343:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554684928 00000100:00100000:2.0:1788869634.970415:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788869634.970426:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554684928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869634.970474:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554684928:12345-0@lo:400:kworker.0 Request processed in 51us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869634.970482:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788869634.970502:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554684544 00000100:00100000:2.0:1788869634.970506:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554684544 00000100:00100000:2.0:1788869634.970531:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554685056 00000100:00100000:2.0:1788869634.970534:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554685056 00000100:00100000:2.0:1788869634.970554:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788869634.970560:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875765554684544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869634.970605:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875765554684544:12345-0@lo:400:kworker.0 Request processed in 45us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869634.970611:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788869634.970623:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788869634.970630:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875765554685056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869634.970655:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875765554685056:12345-0@lo:400:kworker.0 Request processed in 26us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869634.970661:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:2.0:1788869634.970679:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869634.970683:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869634.970714:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875765554684544:0@lo:400:kworker.0 00000100:00100000:2.0:1788869634.970725:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875765554685056:0@lo:400:kworker.0 00010000:00080000:2.0:1788869634.970737:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82cb5180 x1875765554684928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869634.970746:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554684928:0@lo:400:kworker.0 00000100:00100000:1.0:1788869634.971557:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554684032 00000100:00100000:1.0:1788869634.971564:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554684032 00000100:00100000:1.0:1788869634.971606:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788869634.971623:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3616:x1875765554684032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869634.971673:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3616:x1875765554684032:12345-0@lo:400:kworker.0 Request processed in 52us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869634.971679:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788869634.971716:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554684160:0@lo:400:kworker.0 00000100:00100000:1.0:1788869634.971742:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869634.971764:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554684672:0@lo:400:kworker.0 00000100:00100000:1.0:1788869634.971784:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869634.971799:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875765554685184:0@lo:400:kworker.0 00000100:00100000:1.0:1788869634.971818:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869634.971835:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788869634.971841:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554684288:0@lo:400:kworker.0 00000100:00100000:1.0:1788869634.971862:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869634.971876:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554684800:0@lo:400:kworker.0 00000100:00100000:1.0:1788869634.971922:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869634.971942:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554685312:0@lo:400:kworker.0 00000100:00100000:1.0:1788869634.971963:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869634.971990:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554684800 00000100:00100000:1.0:1788869634.971994:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554684800 00000100:00100000:1.0:1788869634.972021:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554685312 00000100:00100000:1.0:1788869634.972023:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554685312 00000100:00100000:1.0:1788869634.972039:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788869634.972045:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554684800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869634.972078:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554684800:12345-0@lo:400:kworker.0 Request processed in 33us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869634.972093:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788869634.972107:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788869634.972112:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554685312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869634.972139:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554685312:12345-0@lo:400:kworker.0 Request processed in 27us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869634.972144:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788869634.972482:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554684416 00000100:00100000:0.0:1788869634.972487:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554684416 00000100:00100000:0.0:1788869634.972515:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788869634.972522:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554684416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869634.972560:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554684416:12345-0@lo:400:kworker.0 Request processed in 39us (2555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869634.972566:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:1.0:1788869634.974028:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82cb7800 x1875765554684800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869634.974047:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554684800:0@lo:400:kworker.0 00010000:00080000:1.0:1788869634.974074:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82cb5500 x1875765554685312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869634.974083:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554685312:0@lo:400:kworker.0 00000100:00100000:1.0:1788869634.976812:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869634.976837:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554685440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869634.979477:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869634.981097:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554684160 00000100:00100000:2.0:1788869634.981109:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554684160 00000100:00100000:2.0:1788869634.981179:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554684672 00000100:00100000:2.0:1788869634.981183:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554684672 00000100:00100000:2.0:1788869634.981201:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554685184 00000100:00100000:2.0:1788869634.981204:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554685184 00000100:00100000:2.0:1788869634.981217:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554684288 00000100:00100000:2.0:1788869634.981220:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554684288 00000100:00100000:2.0:1788869634.981234:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788869634.981243:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554684160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869634.981585:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788869634.981596:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554684672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869634.981661:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554684672:12345-0@lo:400:kworker.0 Request processed in 68us (9874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869634.981667:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788869634.981684:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788869634.981691:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875765554685184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869634.981721:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875765554685184:12345-0@lo:400:kworker.0 Request processed in 32us (9902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869634.981726:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788869634.981736:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788869634.981741:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554684288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869634.981763:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554684288:12345-0@lo:400:kworker.0 Request processed in 22us (9901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869634.981768:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788869634.981821:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554684032:0@lo:400:kworker.0 00000100:00100000:3.0:1788869634.981836:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554684416:0@lo:400:kworker.0 00000100:00080000:3.0:1788869634.981869:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869634.981874:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869634.981876:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869634.981948:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554684160:12345-0@lo:400:kworker.0 Request processed in 705us (10204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869634.981961:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788869634.983432:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554685440 00000100:00100000:0.0:1788869634.983444:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554685440 00000100:00100000:0.0:1788869634.983500:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788869634.983521:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554685440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869634.983545:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869634.983626:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554685440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (4154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869634.983632:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1788869634.986974:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe81c8ea00 x1875765554685440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869650 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869634.987002:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554685440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869634.987610:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554684288:0@lo:400:kworker.0 00000100:00100000:1.0:1788869634.987624:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554684160:0@lo:400:kworker.0 00010000:00080000:1.0:1788869634.987637:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82cb4000 x1875765554684672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869634.987647:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554684672:0@lo:400:kworker.0 00010000:00080000:1.0:1788869634.987658:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82cb5f80 x1875765554685184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869634.987693:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875765554685184:0@lo:400:kworker.0 00010000:00010000:1.0:1788869635.096667:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869636.122382:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869636.713674:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869636.713728:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869636.713762:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869636.713814:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869636.713843:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869636.713871:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545161472 00000100:00100000:3.0:1788869636.713882:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545161472 00000100:00100000:3.0:1788869636.713941:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545161728 00000100:00100000:3.0:1788869636.713944:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545161728 00000100:00100000:3.0:1788869636.713957:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545161344 00000100:00100000:3.0:1788869636.713959:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545161344 00000100:00100000:3.0:1788869636.713971:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545161600 00000100:00100000:3.0:1788869636.713973:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545161600 00000100:00100000:3.0:1788869636.713989:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 209 00000100:00100000:3.0:1788869636.713998:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545161472:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869636.714090:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545161472:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 91us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869636.714106:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 209 00000100:00100000:3.0:1788869636.714123:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 210 00000100:00100000:3.0:1788869636.714129:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545161728:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869636.714169:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545161728:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869636.714176:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 210 00000100:00100000:3.0:1788869636.714188:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 211 00000100:00100000:3.0:1788869636.714195:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2390:x1875765545161344:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869636.714220:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2390:x1875765545161344:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869636.714225:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 211 00000100:00100000:3.0:1788869636.714236:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 212 00000100:00100000:3.0:1788869636.714249:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545161600:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869636.714317:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545161600:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 69us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869636.714323:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 212 00000100:00080000:3.0:1788869636.714341:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869636.714345:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869636.714740:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545161216 00000100:00100000:1.0:1788869636.714746:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545161216 00000100:00100000:1.0:1788869636.714795:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 334 00000100:00100000:1.0:1788869636.714803:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2390:x1875765545161216:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869636.714835:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2390:x1875765545161216:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869636.714840:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 334 00000100:00100000:2.0:1788869637.017438:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869637.017464:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554685568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869637.017548:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869637.017762:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554685568 00000100:00100000:0.0:1788869637.017773:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554685568 00000100:00100000:0.0:1788869637.017844:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788869637.017855:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554685568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869637.017898:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869637.017948:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554685568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869637.017955:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:0.0:1788869637.017997:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82cb7480 x1875765554685568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869637.018015:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554685568:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788869637.018788:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869637.018846:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554685696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869637.018897:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869637.019030:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554685696 00000100:00100000:1.0:1788869637.019035:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554685696 00000100:00100000:1.0:1788869637.019091:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788869637.019107:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554685696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869637.019122:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869637.019472:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554685696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 374us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869637.019480:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:1.0:1788869637.019541:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffae6adf80 x1875765554685696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869637.019556:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554685696:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788869637.019698:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788869637.144648:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869637.530316:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554685824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869637.530402:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869637.530490:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554685824 00000100:00100000:0.0:1788869637.530498:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554685824 00000100:00100000:0.0:1788869637.530567:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788869637.530576:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554685824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869637.532279:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788869637.532381:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554685824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1804us (1978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869637.532390:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788869637.532846:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554685824:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1788869637.880119:0:13499:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:13:57 (1788869637) === 00000100:00100000:0.0:1788869638.145008:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869638.146608:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545161856 00000100:00100000:3.0:1788869638.146621:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545161856 00000100:00100000:3.0:1788869638.146747:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:3.0:1788869638.146759:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2388:x1875765545161856:12345-192.168.201.30@tcp:41:mkdir.0 00000004:00000024:3.0:1788869638.146832:0:6485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788869638.146862:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869638.146920:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2388:x1875765545161856:12345-192.168.201.30@tcp:41:mkdir.0 Request processed in 162us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869638.146927:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00080000:2.0:1788869638.147418:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869638.147434:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545161984 00000100:00100000:2.0:1788869638.147437:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545161984 00000100:00100000:2.0:1788869638.147470:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:2.0:1788869638.147477:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bf4fff62-1855-4361-a244-1a23eb291d37+6:10484:x1875765545161984:12345-192.168.201.30@tcp:700:mkdir.0 00000100:00100000:2.0:1788869638.147526:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bf4fff62-1855-4361-a244-1a23eb291d37+6:10484:x1875765545161984:12345-192.168.201.30@tcp:700:mkdir.0 Request processed in 49us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869638.147534:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:1.0:1788869638.161616:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869638.161654:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545162240 00000100:00100000:1.0:1788869638.161673:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545162240 00000100:00100000:1.0:1788869638.161728:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:1.0:1788869638.161738:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+6:10484:x1875765545162240:12345-192.168.201.30@tcp:36:mkdir.0 00010000:00010000:1.0:1788869638.161801:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869638.161859:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2400/0xbead52e175fc2c19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa904 expref: 6 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.161879:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fe820c1500) 00010000:00010000:1.0:1788869638.161891:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869638.161979:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9400/0xbead52e175fc2d77 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.161993:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9400/0xbead52e175fc2d77 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.162004:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9400/0xbead52e175fc2d77 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.163657:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8a00/0xbead52e175fc2d7e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.163677:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8a00/0xbead52e175fc2d7e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.163687:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8a00/0xbead52e175fc2d7e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.164423:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9a00/0xbead52e175fc2d85 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.164434:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9a00/0xbead52e175fc2d85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.164450:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9a00/0xbead52e175fc2d85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788869638.164468:0:6486:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e2a9cd8f reply state 00000000b34ea9f1 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9a00/0xbead52e175fc2d85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.164478:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9a00/0xbead52e175fc2d85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.164483:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99fe831e3800) 00010000:00010000:1.0:1788869638.164485:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788869638.164488:0:6486:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788869638.164493:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788869638.164500:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9400/0xbead52e175fc2d77 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.164504:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9400/0xbead52e175fc2d77 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.164509:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9400/0xbead52e175fc2d77 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.164513:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a9400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869638.164516:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9400/0xbead52e175fc2d77 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.164520:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9400/0xbead52e175fc2d77 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.164527:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fe831e3600) 00010000:00010000:1.0:1788869638.164529:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869638.164546:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9400/0xbead52e175fc2d77 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.164551:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9400/0xbead52e175fc2d77 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788869638.164565:0:6486:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e2a9cd8f reply state 00000000b34ea9f1 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8a00/0xbead52e175fc2d7e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.164570:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8a00/0xbead52e175fc2d7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.164574:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99fe831e3900) 00010000:00010000:1.0:1788869638.164576:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788869638.164577:0:6486:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788869638.164665:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+7:10484:x1875765545162240:12345-192.168.201.30@tcp:36:mkdir.0 Request processed in 2926us (3055us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788869638.164672:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00010000:00010000:3.0:1788869638.175606:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869638.209223:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869638.209444:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545162368 00000100:00100000:3.0:1788869638.209455:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545162368 00000100:00100000:3.0:1788869638.209553:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:3.0:1788869638.209564:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+7:10485:x1875765545162368:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1788869638.209586:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869638.209611:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc2d8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa997 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.209686:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2d93 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.209718:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2d93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.209730:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2d93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869638.209775:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788869638.209779:0:12967:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869638.209811:0:12967:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2d93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.209837:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc2d8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa997 expref: 9 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.209853:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2d93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa997 expref: 8 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.209861:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffb982dc00) 00010000:00010000:3.0:1788869638.209863:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869638.209866:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9fc00, rc 0) 00000100:00100000:3.0:1788869638.210052:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+8:10485:x1875765545162368:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 490us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869638.210059:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:1.0:1788869638.223366:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869638.223498:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545162624 00000100:00100000:3.0:1788869638.223508:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545162624 00000100:00100000:3.0:1788869638.223568:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:3.0:1788869638.223577:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+8:10485:x1875765545162624:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:3.0:1788869638.223638:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869638.223675:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2d93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa997 expref: 8 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.223693:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffb982dc00) 00010000:00010000:3.0:1788869638.223704:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869638.223729:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc2d9a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.223742:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc2d9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.223752:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc2d9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869638.223970:0:9496:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009e997704 reply state 000000002370cfe1 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc2d9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.223983:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc2d9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.223990:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffb982dd00) 00010000:00010000:3.0:1788869638.223992:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788869638.223995:0:9496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788869638.224003:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788869638.224094:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+9:10485:x1875765545162624:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 517us (737us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788869638.224101:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:1.0:1788869638.269535:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869638.269659:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545162752 00000100:00100000:2.0:1788869638.269669:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545162752 00000100:00100000:2.0:1788869638.269849:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:2.0:1788869638.269861:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+9:10486:x1875765545162752:12345-192.168.201.30@tcp:101:chown.0 00010000:00010000:2.0:1788869638.269885:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869638.269913:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2da1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa99e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.269997:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc2da8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.270022:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc2da8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.270034:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc2da8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869638.270084:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788869638.270088:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869638.270139:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc2da8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.270167:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2da1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa99e expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.270185:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc2da8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa99e expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.270193:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffb982dd00) 00010000:00010000:2.0:1788869638.270196:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869638.270199:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1e00, rc 0) 00000100:00100000:2.0:1788869638.270314:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+10:10486:x1875765545162752:12345-192.168.201.30@tcp:101:chown.0 Request processed in 455us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869638.270322:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:1.0:1788869638.275668:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869638.280528:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545162880 00000100:00100000:0.0:1788869638.280543:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545162880 00000100:00100000:2.0:1788869638.280801:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:2.0:1788869638.280817:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+10:10486:x1875765545162880:12345-192.168.201.30@tcp:101:chown.0 00010000:00010000:2.0:1788869638.280841:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869638.280863:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2daf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa9a5 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.281050:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2db6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.281065:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2db6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.281076:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2db6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.281087:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2dbd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.281094:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2dbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.281101:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2dbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.281186:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc2dc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.281195:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc2dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.281202:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc2dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869638.281242:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788869638.281272:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869638.281290:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc2dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.284779:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2db6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.284787:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2db6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.284795:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2db6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.284801:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869638.284806:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2db6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.284813:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2db6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.284829:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffb982dd00) 00010000:00010000:2.0:1788869638.284832:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869638.284836:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2db6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.284843:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2db6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.284859:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2dbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.286526:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2dbd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.286534:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2dbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.287172:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0600 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869638.287176:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2dbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.287185:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2dbd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.287200:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99fe831e3900) 00010000:00010000:2.0:1788869638.287202:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869638.287206:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2dbd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.287212:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2dbd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.287283:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2daf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9a5 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.287296:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc2dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9a5 expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.287303:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99fe831e3800) 00010000:00010000:2.0:1788869638.287305:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869638.287307:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0800, rc 0) 00000100:00100000:2.0:1788869638.287402:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+11:10486:x1875765545162880:12345-192.168.201.30@tcp:101:chown.0 Request processed in 6589us (11743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869638.287411:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:1.0:1788869638.309070:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869638.309837:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545163008 00000100:00100000:0.0:1788869638.309847:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545163008 00000100:00100000:0.0:1788869638.309912:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:0.0:1788869638.309924:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bf4fff62-1855-4361-a244-1a23eb291d37+11:10486:x1875765545163008:12345-192.168.201.30@tcp:900:chown.0 00000100:00100000:0.0:1788869638.310011:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bf4fff62-1855-4361-a244-1a23eb291d37+11:10486:x1875765545163008:12345-192.168.201.30@tcp:900:chown.0 Request processed in 90us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869638.310018:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:1.0:1788869638.314387:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869638.314602:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545163264 00000100:00100000:3.0:1788869638.314611:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545163264 00000100:00100000:3.0:1788869638.314667:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:3.0:1788869638.314676:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+11:10486:x1875765545163264:12345-192.168.201.30@tcp:36:chown.0 00010000:00010000:3.0:1788869638.314750:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869638.314775:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc2dc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9a5 expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.314794:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99fe831e3800) 00010000:00010000:3.0:1788869638.314799:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869638.314822:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2dcb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.314835:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2dcb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.314845:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2dcb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869638.324363:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:3.0:1788869638.324697:0:9496:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003f8551b5 reply state 00000000557ab286 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2dcb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.324723:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2dcb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.324732:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99fe831e3800) 00010000:00010000:3.0:1788869638.324735:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788869638.324739:0:9496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788869638.324751:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:3.0:1788869638.324856:0:9496:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788869638.324872:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+9:10486:x1875765545163264:12345-192.168.201.30@tcp:36:chown.0 Request processed in 10193us (10489us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788869638.324882:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 28 00010000:00010000:1.0:1788869638.325797:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8a00/0xbead52e175fc2d7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.325809:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8a00/0xbead52e175fc2d7e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.325818:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8a00/0xbead52e175fc2d7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.325835:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a8a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869638.325841:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8a00/0xbead52e175fc2d7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.325848:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8a00/0xbead52e175fc2d7e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.325862:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99fe831e3900) 00010000:00010000:1.0:1788869638.325957:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869638.325962:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8a00/0xbead52e175fc2d7e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.325969:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8a00/0xbead52e175fc2d7e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.325989:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9a00/0xbead52e175fc2d85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.325996:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9a00/0xbead52e175fc2d85 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.326002:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9a00/0xbead52e175fc2d85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.326007:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a9a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869638.326009:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9a00/0xbead52e175fc2d85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.326015:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9a00/0xbead52e175fc2d85 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.326032:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99fe831e3800) 00010000:00010000:1.0:1788869638.326035:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869638.326038:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9a00/0xbead52e175fc2d85 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.326043:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9a00/0xbead52e175fc2d85 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.326056:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc2d9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.327768:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc2d9a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.327788:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc2d9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.327794:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9ee00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869638.327799:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc2d9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.327808:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc2d9a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.327825:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffb982dd00) 00010000:00010000:1.0:1788869638.327827:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788869638.327832:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc2d9a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.327840:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc2d9a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.327847:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2dcb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.327877:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2dcb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.327887:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2dcb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.327894:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fc00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869638.327899:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2dcb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.327907:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2dcb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.327923:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99fe831e3800) 00010000:00010000:2.0:1788869638.327926:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788869638.327931:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2dcb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.327938:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2dcb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869638.353738:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869638.353834:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545163392 00000100:00100000:0.0:1788869638.353844:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545163392 00000100:00100000:0.0:1788869638.353919:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:0.0:1788869638.353932:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:10488:x1875765545163392:12345-192.168.201.30@tcp:101:touch.500 00010000:00010000:0.0:1788869638.353959:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869638.353980:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc2dd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa9ac expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788869638.366720:0:6485:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 12682us 00010000:00010000:0.0:1788869638.390316:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc2dd9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390352:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc2dd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390366:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc2dd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390391:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2a00/0xbead52e175fc2de0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390400:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2a00/0xbead52e175fc2de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390407:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2a00/0xbead52e175fc2de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390530:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2400/0xbead52e175fc2de7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390538:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2400/0xbead52e175fc2de7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390545:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2400/0xbead52e175fc2de7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869638.390579:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788869638.390583:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869638.390621:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2400/0xbead52e175fc2de7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390634:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc2dd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390640:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc2dd9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390647:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc2dd9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390663:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb98e3000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869638.390667:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc2dd9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390675:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc2dd9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390687:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffb982dd00) 00010000:00010000:0.0:1788869638.390690:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869638.390695:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc2dd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390702:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc2dd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390714:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2a00/0xbead52e175fc2de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390720:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2a00/0xbead52e175fc2de0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390727:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2a00/0xbead52e175fc2de0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390732:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb98e2a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869638.390735:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2a00/0xbead52e175fc2de0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390741:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2a00/0xbead52e175fc2de0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390759:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99fe821d6f00) 00010000:00010000:0.0:1788869638.390761:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869638.390764:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2a00/0xbead52e175fc2de0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390770:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2a00/0xbead52e175fc2de0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390808:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc2dd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9ac expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390822:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2400/0xbead52e175fc2de7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9ac expref: 7 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.390829:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99fe821d6900) 00010000:00010000:0.0:1788869638.390831:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788869638.390833:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb98e2400, rc 0) 00000100:00100000:0.0:1788869638.390918:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+7:10488:x1875765545163392:12345-192.168.201.30@tcp:101:touch.500 Request processed in 36987us (37186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869638.390927:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:1.0:1788869638.397861:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869638.397934:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545163648 00000100:00100000:2.0:1788869638.397944:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545163648 00000100:00100000:2.0:1788869638.398005:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:2.0:1788869638.398016:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+7:10488:x1875765545163648:12345-192.168.201.30@tcp:101:touch.500 00010000:00010000:2.0:1788869638.398035:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869638.398056:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2dee lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa9b3 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.398239:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2df5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.398300:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2df5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.398313:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2df5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.398358:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2dfc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.398367:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2dfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.398374:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2dfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788869638.398746:0:6484:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788869638.398891:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2e03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.398901:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2e03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.398909:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2e03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.398944:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2df5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.398952:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2df5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.398959:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2df5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.398972:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0600 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869638.398977:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2df5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.398984:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2df5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.398997:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99fe821d6900) 00010000:00010000:2.0:1788869638.399000:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869638.399005:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2df5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.399011:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2df5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869638.399025:0:6484:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000848dae0 reply state 00000000d1f319c0 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2dfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.399035:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2dfc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.399041:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x249f6e23 (ffff99ffb89e0d00) 00010000:00010000:2.0:1788869638.399044:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788869638.399047:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788869638.399079:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2dee lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9b3 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.399095:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2e03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9b3 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.399113:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff99ffb89e0400) 00010000:00010000:2.0:1788869638.399115:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869638.399118:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1000, rc 0) 00000100:00100000:2.0:1788869638.399184:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+10:10488:x1875765545163648:12345-192.168.201.30@tcp:101:touch.500 Request processed in 1170us (1332us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788869638.399193:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:3.0:1788869638.404891:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869638.404999:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545163904 00000100:00100000:2.0:1788869638.405014:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545163904 00000100:00100000:2.0:1788869638.405244:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:2.0:1788869638.405292:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+10:10488:x1875765545163904:12345-192.168.201.30@tcp:36:touch.500 00010000:00010000:2.0:1788869638.405454:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869638.405483:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2e03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9b3 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.405502:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff99ffb89e0400) 00010000:00010000:2.0:1788869638.405512:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869638.405563:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0e00/0xbead52e175fc2e11 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.405576:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0e00/0xbead52e175fc2e11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.405586:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0e00/0xbead52e175fc2e11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869638.405697:0:9496:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000c01eeb6 reply state 00000000367cfade transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0e00/0xbead52e175fc2e11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.405722:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0e00/0xbead52e175fc2e11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.405729:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff99ffb89e0300) 00010000:00010000:2.0:1788869638.405731:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788869638.405734:0:9496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869638.405901:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+11:10488:x1875765545163904:12345-192.168.201.30@tcp:36:touch.500 Request processed in 647us (1018us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788869638.405909:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:1.0:1788869638.407673:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869638.407747:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545164032 00000100:00100000:0.0:1788869638.407758:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545164032 00000100:00100000:0.0:1788869638.407806:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:0.0:1788869638.407814:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+11:10488:x1875765545164032:12345-192.168.201.30@tcp:101:touch.500 00010000:00010000:0.0:1788869638.407834:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869638.407852:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc2e18 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa9ba expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.407924:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc2e18 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9ba expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.407938:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc2e18 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9ba expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.407955:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff99ffb89e0300) 00010000:00010000:0.0:1788869638.407958:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869638.407961:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb98e3400, rc 0) 00000100:00100000:0.0:1788869638.408020:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+12:10488:x1875765545164032:12345-192.168.201.30@tcp:101:touch.500 Request processed in 206us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869638.408027:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:0.0:1788869638.412652:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869638.412721:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545164160 00000100:00100000:1.0:1788869638.412731:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545164160 00000100:00100000:1.0:1788869638.412779:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:1.0:1788869638.412787:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2386:x1875765545164160:12345-192.168.201.30@tcp:8:touch.500 00010000:00080000:1.0:1788869638.412821:0:8400:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:1.0:1788869638.412853:0:8400:0:(genops.c:1406:class_connect()) connect: client bf4fff62-1855-4361-a244-1a23eb291d37, cookie 0xbead52e175fc2e1f 00002000:00100000:1.0:1788869638.412865:0:8400:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bf4fff62-1855-4361-a244-1a23eb291d37/ffff99fe83862800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788869638.412883:0:8400:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788869638.413517:0:8400:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788869638.413547:0:8400:0:(import.c:65:import_set_state_nolock()) ffff99fe83860000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869638.413649:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2386:x1875765545164160:12345-192.168.201.30@tcp:8:touch.500 Request processed in 860us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869638.413659:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:3.0:1788869638.421885:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869638.422840:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545164288 00000100:00100000:2.0:1788869638.422851:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545164288 00000100:00100000:2.0:1788869638.422956:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:2.0:1788869638.422967:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+6:0:x1875765545164288:12345-192.168.201.30@tcp:2:touch.500 00000100:00080000:3.0:1788869638.425638:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788869638.439530:0:8393:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:0.0:1788869638.439543:0:8393:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bf4fff62-1855-4361-a244-1a23eb291d37 00000100:00100000:2.0:1788869638.439725:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+5:0:x1875765545164288:12345-192.168.201.30@tcp:2:touch.500 Request processed in 16754us (17843us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788869638.439737:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:3.0:1788869638.444509:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869638.444613:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545164544 00000100:00100000:0.0:1788869638.444622:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545164544 00000100:00100000:0.0:1788869638.444680:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:0.0:1788869638.444689:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+12:10488:x1875765545164544:12345-192.168.201.30@tcp:35:touch.500 00000100:00100000:0.0:1788869638.444997:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+13:10488:x1875765545164544:12345-192.168.201.30@tcp:35:touch.500 Request processed in 307us (495us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788869638.445005:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:0.0:1788869638.468854:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869638.468956:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545164672 00000100:00100000:1.0:1788869638.468965:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545164672 00000100:00100000:1.0:1788869638.469023:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:1.0:1788869638.469033:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+13:10489:x1875765545164672:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1788869638.469057:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869638.469091:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8a00/0xbead52e175fc2e26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa9c1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.469471:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc2e2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.469486:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc2e2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869638.469613:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc2e2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869638.469711:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788869638.469716:0:6486:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869638.469751:0:6486:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc2e2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.469779:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8a00/0xbead52e175fc2e26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9c1 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.469798:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc2e2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9c1 expref: 14 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.469820:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99fe821d6900) 00010000:00010000:2.0:1788869638.469823:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869638.469827:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a8c00, rc 0) 00000100:00100000:2.0:1788869638.469887:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+14:10489:x1875765545164672:12345-192.168.201.30@tcp:101:rm.0 Request processed in 855us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869638.469895:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:3.0:1788869638.474954:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869638.475035:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545164928 00000100:00100000:2.0:1788869638.475045:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545164928 00000100:00100000:2.0:1788869638.475123:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:2.0:1788869638.475133:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+14:10489:x1875765545164928:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1788869638.475163:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869638.475185:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2e34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa9c8 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869638.475326:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788869638.475446:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2e34 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9c8 expref: 16 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.475459:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffb982dd00) 00010000:00010000:2.0:1788869638.475463:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788869638.475467:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2e34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9c8 expref: 16 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.475479:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1000, rc 0) 00000100:00100000:2.0:1788869638.476225:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+15:10489:x1875765545164928:12345-192.168.201.30@tcp:101:rm.0 Request processed in 1091us (1278us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788869638.476249:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:3.0:1788869638.482474:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869638.482669:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545165056 00000100:00100000:0.0:1788869638.482679:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545165056 00000100:00100000:0.0:1788869638.482747:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:0.0:1788869638.482756:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+15:10489:x1875765545165056:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:3.0:1788869638.489192:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+15:10489:x1875765545165056:12345-192.168.201.30@tcp:37:rm.0 Request processed in 6426us (6717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869638.489207:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:3.0:1788869638.493908:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869638.494049:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545165312 00000100:00100000:1.0:1788869638.494060:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545165312 00000100:00100000:1.0:1788869638.494128:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:1.0:1788869638.494139:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae5b8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+15:10489:x1875765545165312:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:1.0:1788869638.494578:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae5b8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+16:10489:x1875765545165312:12345-192.168.201.30@tcp:35:rm.0 Request processed in 439us (677us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788869638.494585:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:1.0:1788869638.514635:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869638.514795:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545165568 00000100:00100000:2.0:1788869638.514806:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545165568 00000100:00100000:2.0:1788869638.514877:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:2.0:1788869638.514888:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+16:10489:x1875765545165568:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1788869638.514914:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869638.514952:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2e42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa9cf expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.515061:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2e49 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.515089:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2e49 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.515102:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2e49 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869638.515113:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788869638.516080:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2e42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9cf expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.516106:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2e49 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9cf expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.516115:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99fe821d6900) 00010000:00010000:2.0:1788869638.516118:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788869638.516122:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0c00, rc 0) 00000100:00100000:2.0:1788869638.516205:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+18:10489:x1875765545165568:12345-192.168.201.30@tcp:101:rm.0 Request processed in 1318us (1579us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788869638.516213:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:0.0:1788869638.525081:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869638.525195:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545165696 00000100:00100000:2.0:1788869638.525203:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545165696 00000100:00100000:2.0:1788869638.525277:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:2.0:1788869638.525288:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+18:10489:x1875765545165696:12345-192.168.201.30@tcp:41:rm.0 00000004:00000024:2.0:1788869638.525364:0:6486:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1788869638.525430:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+18:10489:x1875765545165696:12345-192.168.201.30@tcp:41:rm.0 Request processed in 144us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869638.525438:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:3.0:1788869638.532510:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869638.537096:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545165824 00000100:00100000:2.0:1788869638.537116:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545165824 00000100:00100000:2.0:1788869638.537189:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:2.0:1788869638.537200:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+18:10489:x1875765545165824:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1788869638.537221:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869638.537242:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2e57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa9d6 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537366:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2e5e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537381:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2e5e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537393:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2e5e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537406:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2e65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537425:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2e65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537433:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2e65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537525:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc2e6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537535:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc2e6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537542:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc2e6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869638.537576:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788869638.537581:0:9496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869638.537598:0:9496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc2e6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537609:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc2e6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537617:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2e5e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537624:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2e5e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537630:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2e5e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537646:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0600 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869638.537650:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2e5e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537658:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2e5e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537671:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99fe821d6900) 00010000:00010000:2.0:1788869638.537674:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869638.537679:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2e5e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537685:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2e5e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537697:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2e65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537702:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2e65 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537708:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2e65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537713:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1600 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869638.537716:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2e65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537722:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2e65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537737:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x249f6e23 (ffff99ffb89e0d00) 00010000:00010000:2.0:1788869638.537740:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869638.537742:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2e65 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537749:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2e65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537773:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2e57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9d6 expref: 20 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537785:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc2e6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9d6 expref: 19 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.537792:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff99ffb89e0300) 00010000:00010000:2.0:1788869638.537794:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869638.537796:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0200, rc 0) 00000100:00100000:2.0:1788869638.537858:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+19:10489:x1875765545165824:12345-192.168.201.30@tcp:101:rm.0 Request processed in 659us (5606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869638.537865:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:1.0:1788869638.545093:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869638.545212:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545166080 00000100:00100000:2.0:1788869638.545222:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545166080 00000100:00100000:2.0:1788869638.545309:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:2.0:1788869638.545329:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+19:10489:x1875765545166080:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1788869638.545425:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788869638.545455:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc2e6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9d6 expref: 19 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.545507:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc2e18 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9ba expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.545520:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff99ffb89e0300) 00010000:00010000:2.0:1788869638.545529:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc2e2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9c1 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.545537:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99fe821d6900) 00010000:00010000:2.0:1788869638.545540:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869638.545564:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2e73 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.545577:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2e73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.545586:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2e73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.545598:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2e7a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.545606:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2e7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.545612:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2e7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.545710:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2e81 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.545731:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2e81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.545739:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2e81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869638.546012:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788869638.546024:0:6484:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 256472770385ns, next at 257472767650ns, rc = 0 00010000:00010000:2.0:1788869638.546072:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc2e88 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.546082:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc2e88 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.546089:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc2e88 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.546097:0:6484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc2e88 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.546117:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc2e88 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.546124:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc2e88 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.546150:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869638.546169:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2e81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.546176:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2e81 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.546188:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2e81 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.546193:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0600 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869638.546197:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2e81 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.546204:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2e81 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.546213:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff99ffb89e0300) 00010000:00010000:2.0:1788869638.546215:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788869638.546219:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2e81 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.546225:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0600/0xbead52e175fc2e81 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.546240:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2e73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.546245:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2e73 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.546291:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2e73 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.546298:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869638.546301:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2e73 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.546317:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2e73 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.546325:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99fe821d6900) 00010000:00010000:2.0:1788869638.546327:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869638.546330:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2e73 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.546336:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2e73 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869638.546365:0:6484:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f2261735 reply state 000000000b5d73fe transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2e7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.546375:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2e7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869638.546381:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x249f6e23 (ffff99ffb89e0d00) 00010000:00010000:2.0:1788869638.546384:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788869638.546386:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869638.546456:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+18:10489:x1875765545166080:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1137us (1370us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788869638.546462:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 38 00010000:00010000:3.0:1788869638.546785:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869638.546792:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc2e88 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.546799:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0a00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869638.546803:0:7425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc2e88 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.546811:0:7425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc2e88 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.546820:0:7425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff99ffb89e0300) 00010000:00010000:3.0:1788869638.546822:0:7425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788869638.546825:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc2e88 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.546831:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc2e88 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869638.546841:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869638.546843:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869638.546851:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869638.559305:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869638.559588:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545166336 00000100:00100000:3.0:1788869638.559597:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545166336 00000100:00100000:3.0:1788869638.559651:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:3.0:1788869638.559660:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+18:10489:x1875765545166336:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:3.0:1788869638.560048:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+19:10489:x1875765545166336:12345-192.168.201.30@tcp:35:rm.0 Request processed in 387us (749us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788869638.560061:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:3.0:1788869638.567364:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869638.567624:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545166592 00000100:00100000:0.0:1788869638.567635:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545166592 00000100:00100000:0.0:1788869638.567698:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:0.0:1788869638.567708:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+19:10489:x1875765545166592:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:0.0:1788869638.567769:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788869638.567797:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2e49 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9cf expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.567820:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2400/0xbead52e175fc2de7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9ac expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.567832:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99fe821d6900) 00010000:00010000:0.0:1788869638.567846:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc2da8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa99e expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.567854:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ffb982dd00) 00010000:00010000:0.0:1788869638.567872:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869638.567898:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc2e8f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.567911:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc2e8f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.567921:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc2e8f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.567948:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2600/0xbead52e175fc2e96 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.567955:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2600/0xbead52e175fc2e96 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.567962:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2600/0xbead52e175fc2e96 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.568035:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc2e9d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.568043:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc2e9d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.568050:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc2e9d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869638.568658:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788869638.568679:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc2e9d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.568687:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc2e9d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.568694:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc2e9d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.568700:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb98e3000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869638.568704:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc2e9d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.568722:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc2e9d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.568732:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99fe821d6f00) 00010000:00010000:0.0:1788869638.568735:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788869638.568739:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc2e9d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.568744:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc2e9d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.568763:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc2e8f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.568769:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc2e8f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.568776:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc2e8f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.568781:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb98e3400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869638.568783:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc2e8f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.568788:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc2e8f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.568795:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fe821d6400) 00010000:00010000:0.0:1788869638.568797:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869638.568800:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc2e8f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.568815:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc2e8f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869638.568827:0:6485:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d86ee156 reply state 0000000067391898 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2600/0xbead52e175fc2e96 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.568838:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2600/0xbead52e175fc2e96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869638.568845:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99fe821d6800) 00010000:00010000:0.0:1788869638.568847:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869638.568849:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869638.569063:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+18:10489:x1875765545166592:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1353us (1705us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788869638.569071:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 39 00010000:00010000:2.0:1788869639.195468:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869639.579514:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554685952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869639.579595:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869639.579708:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554685952 00000100:00100000:2.0:1788869639.579716:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554685952 00000100:00100000:2.0:1788869639.579780:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788869639.579790:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554685952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869639.579825:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869639.579880:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554685952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869639.579887:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:2.0:1788869639.579925:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbf983b80 x1875765554685952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869655 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869639.579944:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554685952:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788869639.579993:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869639.580126:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869639.580144:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554686080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869639.580203:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869639.582454:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554686080 00000100:00100000:3.0:1788869639.582467:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554686080 00000100:00100000:3.0:1788869639.582516:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788869639.582525:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554686080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869639.582563:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788869639.582641:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554686080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (2437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869639.582648:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788869639.582693:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554686080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869640.088393:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869640.088417:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554686208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869640.088486:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869640.088547:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554686208 00000100:00100000:3.0:1788869640.088556:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554686208 00000100:00100000:3.0:1788869640.088612:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788869640.088621:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554686208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869640.088645:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869640.088693:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554686208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869640.088701:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:3.0:1788869640.088737:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe81c8e680 x1875765554686208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869656 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869640.088755:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554686208:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788869640.088936:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869640.089077:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554686464:0@lo:400:kworker.0 00000100:00100000:3.0:1788869640.089104:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869640.089121:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875765554686976:0@lo:400:kworker.0 00000100:00100000:3.0:1788869640.089153:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869640.089173:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875765554687488:0@lo:400:kworker.0 00000100:00100000:3.0:1788869640.089189:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869640.089204:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788869640.089209:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554686592:0@lo:400:kworker.0 00000100:00100000:3.0:1788869640.089229:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869640.089244:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554687104:0@lo:400:kworker.0 00000100:00100000:3.0:1788869640.089283:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869640.089299:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554687616:0@lo:400:kworker.0 00000100:00100000:3.0:1788869640.089337:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869640.089363:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554686464 00000100:00100000:3.0:1788869640.089367:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554686464 00000100:00100000:3.0:1788869640.089385:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554686976 00000100:00100000:3.0:1788869640.089387:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554686976 00000100:00100000:3.0:1788869640.089400:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554687488 00000100:00100000:3.0:1788869640.089403:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554687488 00000100:00100000:3.0:1788869640.089414:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554687104 00000100:00100000:3.0:1788869640.089421:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554687104 00000100:00100000:3.0:1788869640.089433:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554687616 00000100:00100000:3.0:1788869640.089435:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554687616 00000100:00100000:3.0:1788869640.089446:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788869640.089451:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554686464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869640.089485:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554686464:12345-0@lo:400:kworker.0 Request processed in 34us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869640.089491:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788869640.089503:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788869640.089508:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875765554686976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869640.089529:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875765554686976:12345-0@lo:400:kworker.0 Request processed in 22us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869640.089535:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788869640.089544:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788869640.089548:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875765554687488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869640.089567:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875765554687488:12345-0@lo:400:kworker.0 Request processed in 19us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869640.089572:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788869640.089580:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788869640.089585:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554687104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869640.089604:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554687104:12345-0@lo:400:kworker.0 Request processed in 19us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869640.089610:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788869640.089618:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788869640.089623:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554687616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869640.089641:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554687616:12345-0@lo:400:kworker.0 Request processed in 19us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869640.089651:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788869640.089673:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554686592 00000100:00100000:3.0:1788869640.089676:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554686592 00000100:00100000:3.0:1788869640.089695:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788869640.089700:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554686592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869640.089728:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554686592:12345-0@lo:400:kworker.0 Request processed in 28us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869640.089734:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788869640.089763:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554686592:0@lo:400:kworker.0 00010000:00080000:3.0:1788869640.089773:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83a32d80 x1875765554687104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869640.089781:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554687104:0@lo:400:kworker.0 00010000:00080000:3.0:1788869640.089791:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83a30a80 x1875765554687616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869640.089799:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554687616:0@lo:400:kworker.0 00000100:00100000:3.0:1788869640.089808:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554686464:0@lo:400:kworker.0 00000100:00100000:3.0:1788869640.089816:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875765554686976:0@lo:400:kworker.0 00000100:00100000:3.0:1788869640.089823:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875765554687488:0@lo:400:kworker.0 00000100:00100000:1.0:1788869640.089993:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554686720:0@lo:400:kworker.0 00000100:00100000:1.0:1788869640.090022:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869640.090044:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554687232:0@lo:400:kworker.0 00000100:00100000:1.0:1788869640.090073:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869640.090089:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554687744:0@lo:400:kworker.0 00000100:00100000:1.0:1788869640.090105:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869640.090119:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788869640.090135:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554686336:0@lo:400:kworker.0 00000100:00100000:1.0:1788869640.090159:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869640.090179:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554686848:0@lo:400:kworker.0 00000100:00100000:1.0:1788869640.090197:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869640.090209:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554687360:0@lo:400:kworker.0 00000100:00100000:1.0:1788869640.090226:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869640.090246:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554687232 00000100:00100000:1.0:1788869640.090262:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554687232 00000100:00100000:1.0:1788869640.090286:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554687744 00000100:00100000:1.0:1788869640.090289:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554687744 00000100:00100000:1.0:1788869640.090299:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554687360 00000100:00100000:1.0:1788869640.090301:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554687360 00000100:00100000:1.0:1788869640.090325:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788869640.090340:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554687232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869640.090370:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554687232:12345-0@lo:400:kworker.0 Request processed in 40us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869640.090376:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788869640.090387:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788869640.090392:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554687744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869640.090412:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554687744:12345-0@lo:400:kworker.0 Request processed in 21us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869640.090418:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788869640.090433:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788869640.090438:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554687360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869640.090460:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554687360:12345-0@lo:400:kworker.0 Request processed in 22us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869640.090465:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788869640.090482:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554686336 00000100:00100000:1.0:1788869640.090484:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554686336 00000100:00100000:1.0:1788869640.090505:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788869640.090510:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554686336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869640.090533:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554686336:12345-0@lo:400:kworker.0 Request processed in 23us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869640.090539:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788869640.090558:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554686848 00000100:00100000:1.0:1788869640.090561:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554686848 00000100:00100000:1.0:1788869640.090579:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788869640.090584:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554686848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869640.090608:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554686848:12345-0@lo:400:kworker.0 Request processed in 24us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869640.090613:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1788869640.090633:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869640.090637:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869640.090639:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869640.090656:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554686336:0@lo:400:kworker.0 00000100:00100000:1.0:1788869640.090665:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554686848:0@lo:400:kworker.0 00010000:00080000:1.0:1788869640.090675:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83a30e00 x1875765554687360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869640.090694:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554687360:0@lo:400:kworker.0 00010000:00080000:1.0:1788869640.090704:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83a31f80 x1875765554687232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869640.090711:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554687232:0@lo:400:kworker.0 00010000:00080000:1.0:1788869640.090720:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83a32a00 x1875765554687744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869640.090727:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554687744:0@lo:400:kworker.0 00000100:00100000:3.0:1788869640.090877:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554686720 00000100:00100000:3.0:1788869640.090881:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554686720 00000100:00100000:3.0:1788869640.090912:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788869640.090918:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554686720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869640.090955:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554686720:12345-0@lo:400:kworker.0 Request processed in 38us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869640.090961:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788869640.091120:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554686720:0@lo:400:kworker.0 00010000:00010000:3.0:1788869640.217286:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869641.240403:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788869641.759407:0:13646:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:1.0:1788869641.832690:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869641.832743:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869641.832766:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869641.832791:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545166976 00000100:00100000:1.0:1788869641.832795:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869641.832803:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545166976 00000100:00100000:1.0:1788869641.832821:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869641.832872:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545167232 00000100:00100000:0.0:1788869641.832876:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545167232 00000100:00100000:0.0:1788869641.832900:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545166848 00000100:00100000:0.0:1788869641.832903:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545166848 00000100:00100000:1.0:1788869641.832920:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869641.832926:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545167360 00000100:00100000:0.0:1788869641.832930:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545167360 00000100:00100000:1.0:1788869641.832946:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 219 00000100:00100000:0.0:1788869641.832968:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 220 00000100:00100000:0.0:1788869641.832978:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545167232:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869641.832989:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545166720 00000100:00100000:3.0:1788869641.832994:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545166720 00000100:00100000:3.0:1788869641.833032:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 336 00000100:00100000:3.0:1788869641.833041:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2389:x1875765545166720:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869641.833068:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545167232:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 91us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869641.833077:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2389:x1875765545166720:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 36us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869641.833081:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 220 00000100:00100000:3.0:1788869641.833088:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 336 00000100:00100000:0.0:1788869641.833115:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 221 00000100:00100000:0.0:1788869641.833124:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+18:2389:x1875765545166848:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869641.833170:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+18:2389:x1875765545166848:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 47us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869641.833177:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 221 00000100:00100000:0.0:1788869641.833198:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 222 00000100:00100000:1.0:1788869641.833199:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545166976:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869641.833208:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545167360:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869641.833236:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545166976:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 282us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869641.833243:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545167360:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 35us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869641.833249:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 219 00000100:00100000:1.0:1788869641.833316:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545167104 00000100:00100000:1.0:1788869641.833320:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545167104 00000100:00100000:1.0:1788869641.833362:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 89 00000100:00100000:1.0:1788869641.833369:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545167104:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869641.833401:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545167104:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 32us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869641.833408:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 89 00000100:00100000:0.0:1788869641.833694:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 222 00000100:00080000:0.0:1788869641.833714:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788869641.833718:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869641.833720:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788869642.136474:0:8523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 260063218316ns, next at 261063215501ns, rc = 0 00000100:00100000:3.0:1788869642.136647:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554687872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869642.136717:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869642.136802:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869642.136810:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554688000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869642.136834:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869642.136867:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554687872 00000100:00100000:3.0:1788869642.136874:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554687872 00000100:00100000:3.0:1788869642.136920:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554688000 00000100:00100000:3.0:1788869642.136924:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554688000 00000100:00100000:3.0:1788869642.136941:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788869642.136948:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554687872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869642.136974:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869642.137010:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554687872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869642.137025:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788869642.137041:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788869642.137046:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554688000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869642.137055:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869642.137080:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554688000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869642.137085:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1788869642.137098:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788869642.137122:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfa62a00 x1875765554688000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869642.137138:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554688000:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788869642.137159:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82cb5f80 x1875765554687872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869642.137168:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554687872:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788869642.270532:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869642.648902:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869642.648942:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554688128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869642.649012:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869642.650177:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554688128 00000100:00100000:2.0:1788869642.650193:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554688128 00000100:00100000:2.0:1788869642.650287:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788869642.650300:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554688128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869642.650366:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869642.650465:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554688128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 167us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869642.650473:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788869642.650620:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554688128:0@lo:41:osp-pre-1-0.0 00000020:00000080:3.0:1788869643.020231:0:13695:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7f9bcd00 20000000:00000080:3.0:1788869643.020493:0:13695:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99ffbf9ec000 uarg=0000000000000000 20000000:01000000:3.0:1788869643.020540:0:13695:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788869643.020547:0:13695:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788869643.020552:0:13695:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788869643.020908:0:13696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788869643.020995:0:13695:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788869643.024240:0:13695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788869643.024324:0:13695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788869643.024359:0:13695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788869643.024378:0:13695:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788869643.024401:0:13695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffb98e2400/0xbead52e175fc2ea4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.024424:0:13695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2d31 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.024431:0:13695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2d46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2d3f expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.024456:0:13695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2d54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2d4d expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.024462:0:13695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb98e2200/0xbead52e175fc2d62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2d5b expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.024470:0:13695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb98e3200/0xbead52e175fc2d69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa989 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.024477:0:13695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb95a8800/0xbead52e175fc2d70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa990 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.024484:0:13695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffb98e2400/0xbead52e175fc2ea4 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.024525:0:13695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb95a8800/0xbead52e175fc2d70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa990 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.024541:0:13695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffb95a8800/0xbead52e175fc2d70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa990 expref: 12 pid: 6479 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869643.024557:0:13695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa60000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13695:1875765554688256:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788869643.024665:0:13695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb98e3200/0xbead52e175fc2d69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa989 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.024672:0:13695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffb98e3200/0xbead52e175fc2d69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa989 expref: 12 pid: 6478 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869643.024678:0:13695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa60700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13695:1875765554688384:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788869643.024707:0:13695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb98e2200/0xbead52e175fc2d62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2d5b expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.024714:0:13695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffb98e2200/0xbead52e175fc2d62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2d5b expref: 23 pid: 6476 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869643.024721:0:13695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa63480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13695:1875765554688512:0@lo:104: 00000100:00100000:0.0:1788869643.024751:0:13695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788869643.024779:0:13695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2d54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2d4d expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.024785:0:13695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2d54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2d4d expref: 23 pid: 6479 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869643.024792:0:13695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa63100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13695:1875765554688640:0@lo:104: 00000100:00100000:1.0:1788869643.024806:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1788869643.024810:0:13695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2d46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2d3f expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.024817:0:13695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2d46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2d3f expref: 23 pid: 6476 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869643.024822:0:13695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa61c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13695:1875765554688768:0@lo:104: 00000100:00100000:1.0:1788869643.024833:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869643.024851:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554688512 00000100:00100000:1.0:1788869643.024857:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554688512 00000100:00100000:1.0:1788869643.024893:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554688640 00000100:00100000:1.0:1788869643.024896:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554688640 00000100:00100000:1.0:1788869643.024910:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788869643.024919:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+4:13695:x1875765554688512:12345-0@lo:104: 00010000:00010000:1.0:1788869643.024932:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ff81535a00/0xbead52e175fc2d5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2d62 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.024981:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788869643.024988:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+4:13695:x1875765554688512:12345-0@lo:104: Request processed in 70us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869643.024995:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788869643.025033:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788869643.025039:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+3:13695:x1875765554688640:12345-0@lo:104: 00010000:00010000:1.0:1788869643.025047:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ff81535200/0xbead52e175fc2d4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2d54 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.025084:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788869643.025089:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+3:13695:x1875765554688640:12345-0@lo:104: Request processed in 51us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869643.025097:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1788869643.025113:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788869643.025119:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ff81535a00/0xbead52e175fc2d5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2d62 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.025127:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535a00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1788869643.025132:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ff81535a00/0xbead52e175fc2d5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2d62 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.025142:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ff81535a00/0xbead52e175fc2d5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2d62 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869643.025150:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ff81535a00/0xbead52e175fc2d5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2d62 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869643.025157:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788869643.025186:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ff81535a00/0xbead52e175fc2d5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2d62 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.025193:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869643.025213:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ff81535a00/0xbead52e175fc2d5b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2d62 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.025221:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ff81535a00/0xbead52e175fc2d5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2d62 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.025242:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869643.025246:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ff81535200/0xbead52e175fc2d4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2d54 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.025368:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535200 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1788869643.025372:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ff81535200/0xbead52e175fc2d4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2d54 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.025380:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ff81535200/0xbead52e175fc2d4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2d54 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869643.025387:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ff81535200/0xbead52e175fc2d4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2d54 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869643.025392:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788869643.025409:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ff81535200/0xbead52e175fc2d4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2d54 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.025415:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869643.025422:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ff81535200/0xbead52e175fc2d4d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2d54 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.025429:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ff81535200/0xbead52e175fc2d4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2d54 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.025439:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869643.025441:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869643.025442:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869643.025449:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869643.025474:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554689024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869643.025503:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869643.025528:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554688896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869643.025551:0:9487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554689024 00000100:00100000:1.0:1788869643.025556:0:9487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554689024 00000100:00100000:2.0:1788869643.025561:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788869643.025579:0:9487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2d54 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2d4d expref: 24 pid: 6479 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869643.025606:0:9487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554688896 00000100:00100000:1.0:1788869643.025609:0:9487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554688896 00010000:00010000:1.0:1788869643.025621:0:9487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb98e2200/0xbead52e175fc2d62 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2d5b expref: 25 pid: 6476 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869643.025637:0:9487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788869643.025643:0:9487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46892796-b77d-4866-a7cc-ce4160dea4be+25:3619:x1875765554689024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869643.025655:0:9487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869643.025660:0:9487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2d54 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2d4d expref: 25 pid: 6479 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.025671:0:9487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2d54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2d4d expref: 25 pid: 6479 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.025689:0:9487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869643.025717:0:9487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46892796-b77d-4866-a7cc-ce4160dea4be+25:3619:x1875765554689024:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869643.025724:0:9487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788869643.025738:0:9487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788869643.025745:0:9487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554688896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869643.025751:0:9487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869643.025755:0:9487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb98e2200/0xbead52e175fc2d62 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2d5b expref: 24 pid: 6476 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.025770:0:9487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb98e2200/0xbead52e175fc2d62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2d5b expref: 24 pid: 6476 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.025781:0:9487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869643.026002:0:9487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554688896:12345-0@lo:103:ldlm_bl.0 Request processed in 256us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869643.026010:0:9487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788869643.026047:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554689024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869643.026297:0:13695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788869643.026323:0:13695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc2d31 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.026343:0:13695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc2d31 expref: 23 pid: 6479 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869643.026352:0:13695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa61500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13695:1875765554689152:0@lo:104: 00000100:00100000:0.0:1788869643.026382:0:13695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869643.026401:0:13695:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff85566600 going to sleep for 11 seconds 00010000:00010000:0.0:1788869643.026414:0:13695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb98e2200/0xbead52e175fc2d62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2d5b expref: 23 pid: 6476 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869643.026424:0:13695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa63480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13695:1875765554688512:0@lo:104: 00010000:00010000:0.0:1788869643.026435:0:13695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc2d54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2d4d expref: 22 pid: 6479 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869643.026443:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554688768 00000100:00100000:0.0:1788869643.026444:0:13695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa63100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13695:1875765554688640:0@lo:104: 00000100:00100000:1.0:1788869643.026450:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554688768 00000100:00100000:1.0:1788869643.026469:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554689152 00000100:00100000:1.0:1788869643.026471:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554689152 00000100:00100000:1.0:1788869643.026480:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788869643.026486:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+4:13695:x1875765554688768:12345-0@lo:104: 00010000:00010000:1.0:1788869643.026495:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2d3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2d46 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869643.026536:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554688896:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869643.026547:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788869643.026554:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:46892796-b77d-4866-a7cc-ce4160dea4be+4:13695:x1875765554688768:12345-0@lo:104: Request processed in 67us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869643.026562:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788869643.026579:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788869643.026594:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+3:13695:x1875765554689152:12345-0@lo:104: 00010000:00010000:1.0:1788869643.026599:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869643.026602:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8400/0xbead52e175fc2d31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2d38 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.026605:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2d3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2d46 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.026621:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb98e3a00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1788869643.026627:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2d3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2d46 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.026643:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2d3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2d46 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869643.026651:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2d3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2d46 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869643.026657:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788869643.026658:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788869643.026663:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:46892796-b77d-4866-a7cc-ce4160dea4be+3:13695:x1875765554689152:12345-0@lo:104: Request processed in 78us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869643.026669:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1788869643.026682:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2d3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2d46 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.026689:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788869643.026721:0:13695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa61c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13695:1875765554688768:0@lo:104: 00000100:00100000:0.0:1788869643.026728:0:13695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa61500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13695:1875765554689152:0@lo:104: 00010000:00010000:2.0:1788869643.026733:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869643.026740:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8400/0xbead52e175fc2d31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc2d38 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869643.026743:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554689280:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869643.026756:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a8400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1788869643.026760:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8400/0xbead52e175fc2d31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc2d38 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.026775:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8400/0xbead52e175fc2d31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc2d38 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869643.026778:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1788869643.026787:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8400/0xbead52e175fc2d31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc2d38 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869643.026794:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788869643.026814:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8400/0xbead52e175fc2d31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2d38 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869643.026820:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554689280 00010000:00010000:2.0:1788869643.026821:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788869643.026827:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554689280 00010000:00010000:2.0:1788869643.026848:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8400/0xbead52e175fc2d31 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2d38 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869643.026849:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869643.026859:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554689408:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869643.026861:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8400/0xbead52e175fc2d31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2d38 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.026876:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869643.026879:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869643.026881:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869643.026886:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869643.026909:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554689408 00000100:00100000:2.0:1788869643.026913:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554689408 00010000:00010000:2.0:1788869643.026930:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2d31 expref: 22 pid: 6479 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869643.026955:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00010000:00010000:0.0:1788869643.026962:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2d46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2d3f expref: 23 pid: 6476 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869643.026967:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46892796-b77d-4866-a7cc-ce4160dea4be+23:3616:x1875765554689408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869643.026980:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869643.026986:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2d31 expref: 23 pid: 6479 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869643.026987:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788869643.026993:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+23:3616:x1875765554689280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869643.027003:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869643.027012:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2d46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc2d3f expref: 23 pid: 6476 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.027013:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2d31 expref: 23 pid: 6479 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.027066:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2d3f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2d46 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.027076:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3a00/0xbead52e175fc2d3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc2d46 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.027089:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869643.027092:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869643.027094:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869643.027950:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff81535400/0xbead52e175fc2d38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2d31 expref: 23 pid: 6479 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.027952:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2d46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc2d3f expref: 23 pid: 6476 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.027975:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff81534a00/0xbead52e175fc2d46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc2d3f expref: 22 pid: 6476 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.027978:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869643.027994:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869643.028078:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554689408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869643.028533:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46892796-b77d-4866-a7cc-ce4160dea4be+21:3616:x1875765554689408:12345-0@lo:103:ldlm_bl.0 Request processed in 1568us (1645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869643.028539:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+21:3616:x1875765554689280:12345-0@lo:103:ldlm_bl.0 Request processed in 1544us (1761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869643.028548:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788869643.028554:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788869643.029315:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554689280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869643.034416:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869643.034446:0:13695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa60000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13695:1875765554688256:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788869643.034585:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869643.034611:0:13695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa60700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13695:1875765554688384:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788869643.034649:0:13695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffb98e2400/0xbead52e175fc2ea4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869643.049104:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545167488 00000100:00100000:2.0:1788869643.049120:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545167488 00010000:00010000:2.0:1788869643.049177:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb95a8800/0xbead52e175fc2d70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa990 expref: 13 pid: 6479 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869643.049352:0:9487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545167616 00000100:00100000:3.0:1788869643.049357:0:9487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545167616 00010000:00010000:0.0:1788869643.049457:0:9487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb98e3200/0xbead52e175fc2d69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa989 expref: 14 pid: 6478 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869643.049541:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:0.0:1788869643.049551:0:9487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:2.0:1788869643.049556:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3df077ce-aecd-4e92-8493-7099e13a8f7b+14:2388:x1875765545167488:12345-192.168.201.30@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788869643.049567:0:9487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3df077ce-aecd-4e92-8493-7099e13a8f7b+14:2387:x1875765545167616:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869643.049574:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869643.049584:0:9487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869643.049592:0:9487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb98e3200/0xbead52e175fc2d69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa989 expref: 14 pid: 6478 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.049604:0:9487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb98e3200/0xbead52e175fc2d69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa989 expref: 14 pid: 6478 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.049624:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb98e3200/0xbead52e175fc2d69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa989 expref: 14 pid: 6478 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.049639:0:9487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869643.049674:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb95a8800/0xbead52e175fc2d70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa990 expref: 13 pid: 6479 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.049687:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb95a8800/0xbead52e175fc2d70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa990 expref: 13 pid: 6479 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.049700:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb95a8800/0xbead52e175fc2d70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa990 expref: 13 pid: 6479 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.049714:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffb98e2400/0xbead52e175fc2ea4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869643.049715:0:9487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:2387:x1875765545167616:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 152us (15129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869643.049725:0:9487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 51 00010000:00010000:2.0:1788869643.049737:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb98e2400/0xbead52e175fc2ea4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.049755:0:6469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffb98e2400/0xbead52e175fc2ea4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.049764:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffb98e2400/0xbead52e175fc2ea4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.049772:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffb98e2400/0xbead52e175fc2ea4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.049780:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffb98e2400/0xbead52e175fc2ea4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.049786:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb98e2400 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869643.049790:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffb98e2400/0xbead52e175fc2ea4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.049799:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffb98e2400/0xbead52e175fc2ea4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.049816:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffb98e2400/0xbead52e175fc2ea4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.049827:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869643.049849:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3df077ce-aecd-4e92-8493-7099e13a8f7b+11:2388:x1875765545167488:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 299us (15445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869643.049858:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 50 00010000:00010000:0.0:1788869643.049980:0:13695:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffb98e2400/0xbead52e175fc2ea4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.049989:0:13695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffb98e2400/0xbead52e175fc2ea4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.049996:0:13695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb98e2400/0xbead52e175fc2ea4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869643.288497:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788869643.772029:0:13744:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf3993640 20000000:00000080:0.0:1788869643.772045:0:13744:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99ffbfa51400 uarg=0000000000000000 20000000:01000000:0.0:1788869643.772085:0:13744:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788869643.772091:0:13744:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788869643.772096:0:13744:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1788869643.772553:0:13745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1788869643.772876:0:13744:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1788869643.772958:0:13744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1788869643.775051:0:13744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1788869643.775088:0:13744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1788869643.775106:0:13744:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788869643.775125:0:13744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99fe823c0600/0xbead52e175fc2eab lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.775148:0:13744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fe823c0600/0xbead52e175fc2eab lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.775160:0:13744:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99fe823c0600/0xbead52e175fc2eab lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.775167:0:13744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99fe823c0600/0xbead52e175fc2eab lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.775175:0:13744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99fe823c0600/0xbead52e175fc2eab lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.775183:0:13744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99fe823c0600/0xbead52e175fc2eab lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.775189:0:13744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0600 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869643.775194:0:13744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99fe823c0600/0xbead52e175fc2eab lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.775202:0:13744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99fe823c0600/0xbead52e175fc2eab lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.775216:0:13744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99fe823c0600/0xbead52e175fc2eab lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.775224:0:13744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99fe823c0600/0xbead52e175fc2eab lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.775240:0:13744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fe823c0600/0xbead52e175fc2eab lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788869643.777789:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:2.0:1788869643.777945:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869643.777964:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554689536:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788869643.778028:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869643.778087:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554689536 00000100:00100000:2.0:1788869643.778093:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554689536 00000100:00100000:2.0:1788869643.778143:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788869643.778152:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554689536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788869643.778176:0:8527:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1788869643.778204:0:8527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9ffc07, atime: 0x6a9ffc07, ctime: 0x6a9ffc07, blocks: 0x0 00010000:00010000:2.0:1788869643.778212:0:8527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028cc9663/0xbead52e175fc2eb2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.778227:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=261s v=(0 0) 00010000:00010000:2.0:1788869643.778232:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869643.778238:0:8527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028cc9663/0xbead52e175fc2eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.778276:0:8527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028cc9663/0xbead52e175fc2eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.778287:0:8527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028cc9663/0xbead52e175fc2eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.778306:0:8527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028cc9663/0xbead52e175fc2eb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869643.778329:0:8527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869643.778434:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869643.778443:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028cc9663/0xbead52e175fc2eb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869643.778453:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0a00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869643.778459:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028cc9663/0xbead52e175fc2eb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869643.778468:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028cc9663/0xbead52e175fc2eb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869643.778478:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3619:x1875765554689536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 325us (448us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788869643.778486:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788869643.778487:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028cc9663/0xbead52e175fc2eb2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869643.778507:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028cc9663/0xbead52e175fc2eb2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869643.778633:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869643.778636:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869643.778638:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788869643.778686:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fe82325f80/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788869643.778692:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554689536:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1788869643.779304:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1788869643.779321:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1788869643.782571:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2dfc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782588:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2dfc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782596:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2dfc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782603:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869643.782608:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2dfc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782633:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2dfc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782650:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x249f6e23 (ffff99ffb89e0d00) 00010000:00010000:0.0:1788869643.782654:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869643.782659:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2dfc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782666:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2dfc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782686:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0e00/0xbead52e175fc2e11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782693:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0e00/0xbead52e175fc2e11 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782699:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0e00/0xbead52e175fc2e11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782704:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0e00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869643.782707:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0e00/0xbead52e175fc2e11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782713:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0e00/0xbead52e175fc2e11 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782720:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff99ffb89e0300) 00010000:00010000:0.0:1788869643.782722:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869643.782726:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0e00/0xbead52e175fc2e11 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782740:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0e00/0xbead52e175fc2e11 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782758:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2e7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782764:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2e7a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782770:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2e7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782776:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1600 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869643.782779:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2e7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782784:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2e7a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782791:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x249f6e23 (ffff99ffb89e0d00) 00010000:00010000:0.0:1788869643.782793:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869643.782796:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2e7a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782802:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2e7a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x249f6e23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782814:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2600/0xbead52e175fc2e96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782820:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2600/0xbead52e175fc2e96 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782909:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2600/0xbead52e175fc2e96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782916:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb98e2600 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869643.782920:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2600/0xbead52e175fc2e96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782927:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2600/0xbead52e175fc2e96 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782937:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99fe821d6800) 00010000:00010000:0.0:1788869643.782940:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869643.782943:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2600/0xbead52e175fc2e96 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869643.782950:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2600/0xbead52e175fc2e96 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869644.134897:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869644.135105:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545167744 00000100:00100000:1.0:1788869644.135116:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545167744 00000100:00100000:1.0:1788869644.135181:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 337 00000100:00100000:1.0:1788869644.135193:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+11:6155:x1875765545167744:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869644.135224:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869644.135243:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb95a9a00/0xbead52e175fc2eb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa9dd expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869644.135313:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb95a9a00/0xbead52e175fc2eb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9dd expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869644.135482:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb95a9a00/0xbead52e175fc2eb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9dd expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869644.135492:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a9a00, rc 0) 00000100:00100000:1.0:1788869644.135554:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:6155:x1875765545167744:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 363us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869644.135561:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 337 00000100:00100000:0.0:1788869644.137621:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869644.137691:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545167872 00000100:00100000:1.0:1788869644.137700:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545167872 00000100:00100000:1.0:1788869644.137812:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 338 00000100:00100000:1.0:1788869644.137823:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8c32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:6155:x1875765545167872:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869644.137971:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8c32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:6155:x1875765545167872:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 150us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869644.137979:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 338 00000100:00100000:2.0:1788869644.139881:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869644.139974:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545168000 00000100:00100000:0.0:1788869644.139983:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545168000 00000100:00100000:0.0:1788869644.140183:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 339 00000100:00100000:0.0:1788869644.140194:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:6155:x1875765545168000:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869644.140570:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:6155:x1875765545168000:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 377us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869644.140578:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 339 00000100:00100000:2.0:1788869644.145314:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869644.145453:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545168128 00000100:00100000:3.0:1788869644.145464:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545168128 00000100:00100000:3.0:1788869644.145525:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 340 00000100:00100000:3.0:1788869644.145536:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:10772:x1875765545168128:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788869644.145697:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:10772:x1875765545168128:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 159us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869644.145707:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 340 00000100:00100000:3.0:1788869644.155924:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869644.156013:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545168256 00000100:00100000:2.0:1788869644.156030:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545168256 00000100:00100000:2.0:1788869644.156075:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 341 00000100:00100000:2.0:1788869644.156083:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:10772:x1875765545168256:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869644.156222:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:10772:x1875765545168256:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 140us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869644.156229:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 341 00000100:00100000:2.0:1788869644.164639:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869644.164844:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545168384 00000100:00100000:3.0:1788869644.164855:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545168384 00000100:00100000:3.0:1788869644.164917:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 342 00000100:00100000:3.0:1788869644.164929:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:6155:x1875765545168384:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869644.164945:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869644.164964:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb9a9ea00/0xbead52e175fc2ec0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa9e4 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869644.164993:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb9a9ea00/0xbead52e175fc2ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9e4 expref: 13 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869644.165029:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb9a9ea00/0xbead52e175fc2ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9e4 expref: 13 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869644.165038:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9ea00, rc 0) 00000100:00100000:3.0:1788869644.165102:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:6155:x1875765545168384:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 175us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869644.165109:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 342 00000100:00100000:3.0:1788869644.168989:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869644.169468:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545168512 00000100:00100000:0.0:1788869644.169479:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545168512 00000100:00100000:0.0:1788869644.169554:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 343 00000100:00100000:0.0:1788869644.169564:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:6155:x1875765545168512:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869644.171621:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:6155:x1875765545168512:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 2048us (2632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869644.171635:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 343 00000100:00100000:0.0:1788869644.177952:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869644.178062:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545168640 00000100:00100000:2.0:1788869644.178072:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545168640 00000100:00100000:2.0:1788869644.178128:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 344 00000100:00100000:2.0:1788869644.178148:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:6155:x1875765545168640:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869644.178481:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:6155:x1875765545168640:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 344us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869644.178496:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 344 00000100:00100000:2.0:1788869644.189366:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869644.189631:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545168768 00000100:00100000:0.0:1788869644.189643:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545168768 00000100:00100000:0.0:1788869644.189699:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 345 00000100:00100000:0.0:1788869644.189710:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:10776:x1875765545168768:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788869644.189867:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:10776:x1875765545168768:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 159us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869644.189875:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 345 00000100:00100000:0.0:1788869644.194722:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869644.194869:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545168896 00000100:00100000:3.0:1788869644.194879:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545168896 00000100:00100000:3.0:1788869644.195033:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 346 00000100:00100000:3.0:1788869644.195045:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:10776:x1875765545168896:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788869644.195197:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:10776:x1875765545168896:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 154us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869644.195204:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 346 00010000:00010000:1.0:1788869644.312505:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788869644.441515:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788869644.441525:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ffb9bbc800 from 7 10000000:01000000:1.0:1788869644.441531:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869644.441583:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869644.441614:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869644.441636:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869644.441663:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554689664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869644.441737:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869644.441804:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff990d0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869644.442028:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554689664 00000100:00100000:2.0:1788869644.442035:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554689664 00000100:00100000:2.0:1788869644.442144:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788869644.442155:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+20:6481:x1875765554689664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869644.442170:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869644.442185:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fe823c0600/0xbead52e175fc2ece lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2ec7 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869644.442210:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fe823c0600/0xbead52e175fc2ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2ec7 expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869644.442219:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fe823c0600/0xbead52e175fc2ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2ec7 expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869644.442228:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0600, rc 0) 00000100:00100000:2.0:1788869644.442308:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554689664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869644.442315:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788869644.442405:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554689664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869644.442421:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ec7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2ece expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869644.442430:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ec7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2ece expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869644.442487:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554689792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869644.442514:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869644.450499:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff990d0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869644.454635:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554689792 00000100:00100000:0.0:1788869644.454654:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554689792 00000100:00100000:0.0:1788869644.454721:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788869644.454732:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554689792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869644.454917:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554689792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (12401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869644.454925:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788869644.455095:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554689792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869644.455157:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554689920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869644.455214:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869644.455249:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff990d0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869644.455407:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554689920 00000100:00100000:0.0:1788869644.455412:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554689920 00000100:00100000:0.0:1788869644.455433:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788869644.455439:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554689920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869644.455534:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554689920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869644.455549:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788869644.456236:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554689920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869644.457783:0:13757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:13757:1875765554690048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869644.457875:0:13757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869644.457934:0:13757:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff990d0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869644.458003:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554690048 00000100:00100000:0.0:1788869644.458010:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554690048 00000100:00100000:0.0:1788869644.458058:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788869644.458069:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:13757:x1875765554690048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869644.458193:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:13757:x1875765554690048:12345-0@lo:502:llog_process_th.0 Request processed in 126us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869644.458201:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788869644.458678:0:13757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:13757:1875765554690048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869644.458708:0:13757:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869644.458717:0:13757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869644.458719:0:13757:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788869644.458727:0:13757:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ffb9bbc800 00000020:00000080:1.0:1788869644.458730:0:13757:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788869644.458840:0:13757:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869644.458847:0:13757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869644.458848:0:13757:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788869644.458851:0:13757:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869644.458853:0:13757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869644.458854:0:13757:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788869644.458857:0:13757:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ffb9bbc800 00000020:00000080:1.0:1788869644.458859:0:13757:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788869644.464490:0:13757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:13757:1875765554690176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869644.464579:0:13757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869644.464616:0:13757:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff990d0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869644.464848:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554690176 00000100:00100000:0.0:1788869644.464856:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554690176 00000100:00100000:0.0:1788869644.464929:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788869644.464940:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:13757:x1875765554690176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869644.465088:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+21:13757:x1875765554690176:12345-0@lo:502:llog_process_th.0 Request processed in 149us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869644.465096:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788869644.465544:0:13757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:13757:1875765554690176:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869644.465574:0:13757:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869644.465583:0:13757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869644.465585:0:13757:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788869644.465591:0:13757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788869644.465922:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788869644.465947:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788869644.465960:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ec7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2ece expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869644.465973:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2ece expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869644.465987:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788869644.465989:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ffc10cf800 from 7 10000000:01000000:0.0:1788869644.465992:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788869644.466027:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3200/0xbead52e175fc2ed5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869644.466044:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3200/0xbead52e175fc2ed5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869644.466055:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3200/0xbead52e175fc2ed5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869644.466077:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554690304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869644.466127:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869644.466175:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff85870900 going to sleep for 11 seconds 00000100:00100000:1.0:1788869644.466413:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554690304 00000100:00100000:1.0:1788869644.466419:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554690304 00000100:00100000:1.0:1788869644.466450:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788869644.466458:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+21:6481:x1875765554690304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869644.466480:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869644.466492:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb95a9c00/0xbead52e175fc2edc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2ed5 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869644.466514:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb95a9c00/0xbead52e175fc2edc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2ed5 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869644.466525:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb95a9c00/0xbead52e175fc2edc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2ed5 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869644.466534:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a9c00, rc 0) 00000100:00100000:1.0:1788869644.466566:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554690304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869644.466572:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788869644.468220:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554690304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869644.468286:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3200/0xbead52e175fc2ed5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2edc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869644.468396:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3200/0xbead52e175fc2ed5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2edc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869644.468501:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554690432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869644.468567:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869644.469093:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff85870900 going to sleep for 11 seconds 00000100:00100000:1.0:1788869644.473833:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554690432 00000100:00100000:1.0:1788869644.473849:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554690432 00000100:00100000:1.0:1788869644.473928:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788869644.473939:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554690432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869644.474715:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554690432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 776us (6145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869644.474725:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788869644.474811:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554690432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869644.474866:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554690560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869644.474944:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869644.474975:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b66540 going to sleep for 11 seconds 00000100:00100000:1.0:1788869644.474990:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554690560 00000100:00100000:1.0:1788869644.474994:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554690560 00000100:00100000:1.0:1788869644.475037:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788869644.475045:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554690560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869644.475133:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554690560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869644.475140:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788869644.475178:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554690560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869644.480272:0:13760:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:13760:1875765554690688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869644.483273:0:13760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869644.483392:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554690688 00000100:00100000:1.0:1788869644.483400:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554690688 00000100:00100000:1.0:1788869644.483449:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788869644.483459:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88938450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+22:13760:x1875765554690688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869644.483585:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88938450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+22:13760:x1875765554690688:12345-0@lo:502:llog_process_th.0 Request processed in 127us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869644.483593:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788869644.483646:0:13760:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b66840 going to sleep for 11 seconds 00000100:00100000:1.0:1788869644.483668:0:13760:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:13760:1875765554690688:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869644.483696:0:13760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869644.483706:0:13760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869644.483708:0:13760:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788869644.483715:0:13760:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ffc10cf800 00000020:00000080:1.0:1788869644.483718:0:13760:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788869644.483781:0:13760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869644.483784:0:13760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869644.483785:0:13760:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788869644.483787:0:13760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869644.483795:0:13760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869644.483796:0:13760:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788869644.483800:0:13760:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ffc10cf800 00000020:00000080:1.0:1788869644.483802:0:13760:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788869644.483846:0:13760:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:13760:1875765554690816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869644.483878:0:13760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869644.483894:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554690816 00000100:00100000:1.0:1788869644.483896:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554690816 00000100:00100000:1.0:1788869644.484498:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788869644.484505:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88938c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+22:13760:x1875765554690816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869644.484578:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88938c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+22:13760:x1875765554690816:12345-0@lo:502:llog_process_th.0 Request processed in 72us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869644.484584:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788869644.484612:0:13760:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b66840 going to sleep for 11 seconds 00000100:00100000:1.0:1788869644.484623:0:13760:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:13760:1875765554690816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869644.484639:0:13760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869644.484643:0:13760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869644.484645:0:13760:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788869644.484649:0:13760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788869644.484704:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788869644.484737:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869644.484747:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3200/0xbead52e175fc2ed5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2edc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869644.484758:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3200/0xbead52e175fc2ed5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2edc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869644.484768:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788869644.484775:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ff89980800 from 7 10000000:01000000:1.0:1788869644.484778:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869644.484800:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2ee3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869644.484809:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2ee3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869644.484819:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2ee3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869644.484830:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554690944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869644.484854:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869644.484866:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b66840 going to sleep for 11 seconds 00000100:00100000:1.0:1788869644.484877:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554690944 00000100:00100000:1.0:1788869644.484879:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554690944 00000100:00100000:1.0:1788869644.484896:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788869644.484901:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+22:6481:x1875765554690944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869644.484910:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869644.484921:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb95a8a00/0xbead52e175fc2eea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2ee3 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869644.484943:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb95a8a00/0xbead52e175fc2eea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2ee3 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869644.484953:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb95a8a00/0xbead52e175fc2eea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2ee3 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869644.484962:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a8a00, rc 0) 00000100:00100000:1.0:1788869644.484985:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554690944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869644.484996:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788869644.485207:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554690944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869644.485219:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2ee3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2eea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869644.485227:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2ee3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2eea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869644.485471:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554691072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869644.485494:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869644.486415:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b66840 going to sleep for 11 seconds 00000100:00100000:0.0:1788869644.488960:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554691072 00000100:00100000:0.0:1788869644.488977:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554691072 00000040:00080000:3.0:1788869644.489791:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788869644.490346:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788869644.490361:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554691072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869644.490529:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554691072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (5034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869644.490537:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788869644.494144:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554691072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869644.494205:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554691200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869644.494290:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869644.501585:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b889c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869644.501665:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554691200 00000100:00100000:1.0:1788869644.501674:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554691200 00000100:00100000:1.0:1788869644.501717:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788869644.501725:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554691200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869644.501863:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554691200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (7573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869644.501871:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788869644.502095:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554691200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869644.507344:0:13763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:13763:1875765554691328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869644.507417:0:13763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869644.507450:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554691328 00000100:00100000:0.0:1788869644.507456:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554691328 00000100:00100000:0.0:1788869644.507490:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788869644.507498:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88938850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+23:13763:x1875765554691328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869644.507598:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88938850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+23:13763:x1875765554691328:12345-0@lo:502:llog_process_th.0 Request processed in 100us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869644.507606:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788869644.507640:0:13763:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8aa5540 going to sleep for 11 seconds 00000100:00100000:0.0:1788869644.507660:0:13763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:13763:1875765554691328:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788869644.507683:0:13763:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869644.507692:0:13763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869644.507694:0:13763:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788869644.507703:0:13763:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ff89980800 00000020:00000080:0.0:1788869644.507705:0:13763:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788869644.507756:0:13763:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869644.507957:0:13763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869644.507959:0:13763:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788869644.507964:0:13763:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869644.507967:0:13763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869644.507968:0:13763:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788869644.507972:0:13763:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ff89980800 00000020:00000080:0.0:1788869644.507974:0:13763:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788869644.508153:0:13763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:13763:1875765554691456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869644.508185:0:13763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869644.508203:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554691456 00000100:00100000:0.0:1788869644.508207:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554691456 00000100:00100000:0.0:1788869644.508229:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788869644.508234:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88939050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+23:13763:x1875765554691456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869644.508306:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88939050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+23:13763:x1875765554691456:12345-0@lo:502:llog_process_th.0 Request processed in 71us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869644.508312:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788869644.508348:0:13763:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8aa5540 going to sleep for 11 seconds 00000100:00100000:0.0:1788869644.508359:0:13763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:13763:1875765554691456:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788869644.508374:0:13763:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869644.508377:0:13763:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869644.508378:0:13763:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788869644.508382:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788869644.508717:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788869644.508738:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788869644.508748:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2ee3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2eea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869644.508765:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2ee3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2eea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869644.508777:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788869644.508780:0:6481:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ff8b15e800 from 7 10000000:01000000:3.0:1788869644.508782:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788869644.508806:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2ef1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869644.508815:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2ef1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869644.508824:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2ef1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869644.508839:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554691584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788869644.508868:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869644.508892:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b889c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869644.509426:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554691584 00000100:00100000:0.0:1788869644.509431:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554691584 00000100:00100000:0.0:1788869644.509460:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788869644.509467:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88939c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+23:6481:x1875765554691584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869644.509477:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869644.509489:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb98e2600/0xbead52e175fc2ef8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc2ef1 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869644.509508:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb98e2600/0xbead52e175fc2ef8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc2ef1 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869644.509518:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb98e2600/0xbead52e175fc2ef8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc2ef1 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869644.509526:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb98e2600, rc 0) 00000100:00100000:0.0:1788869644.510088:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88939c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554691584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 619us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869644.510105:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1788869644.512141:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554691584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869644.512170:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2ef1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2ef8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869644.512184:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2ef1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2ef8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869644.518995:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82325500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554691712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869644.519139:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869644.519187:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99b8600 going to sleep for 11 seconds 00000100:00100000:0.0:1788869644.519243:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554691712 00000100:00100000:0.0:1788869644.519274:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554691712 00000100:00100000:0.0:1788869644.519329:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788869644.519348:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88939850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554691712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869644.519466:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88939850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554691712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869644.519474:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788869644.519628:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82325500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554691712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869644.519664:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82325500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554691840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869644.519702:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869644.519737:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99b8600 going to sleep for 11 seconds 00000100:00100000:0.0:1788869644.519776:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554691840 00000100:00100000:0.0:1788869644.519780:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554691840 00000100:00100000:0.0:1788869644.519811:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1788869644.519818:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88939450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554691840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869644.519890:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88939450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:6481:x1875765554691840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869644.519897:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788869644.519964:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82325500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:46892796-b77d-4866-a7cc-ce4160dea4be:6481:1875765554691840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788869644.520798:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788869644.531787:0:13765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:13765:1875765554691968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869644.531878:0:13765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869644.531923:0:13765:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8aa5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869644.532168:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554691968 00000100:00100000:2.0:1788869644.532176:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554691968 00000100:00100000:2.0:1788869644.532226:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788869644.532236:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88938050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:13765:x1875765554691968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869644.532729:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88938050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:13765:x1875765554691968:12345-0@lo:502:llog_process_th.0 Request processed in 493us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869644.532737:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1788869644.532871:0:13765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa60000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:13765:1875765554691968:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788869644.532903:0:13765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869644.532916:0:13765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869644.532919:0:13765:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788869644.532932:0:13765:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ff8b15e800 00000020:00000080:0.0:1788869644.532935:0:13765:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788869644.533053:0:13765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869644.533057:0:13765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869644.533059:0:13765:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788869644.533062:0:13765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869644.533065:0:13765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869644.533066:0:13765:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788869644.533069:0:13765:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ff8b15e800 00000020:00000080:0.0:1788869644.533072:0:13765:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788869644.536906:0:13765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:13765:1875765554692096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869644.536988:0:13765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869644.537032:0:13765:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b66840 going to sleep for 11 seconds 00000100:00100000:0.0:1788869644.538163:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554692096 00000100:00100000:0.0:1788869644.538176:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554692096 00000100:00100000:0.0:1788869644.538418:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1788869644.538431:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:13765:x1875765554692096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869644.538594:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:13765:x1875765554692096:12345-0@lo:502:llog_process_th.0 Request processed in 165us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869644.538604:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788869644.539029:0:13765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:46892796-b77d-4866-a7cc-ce4160dea4be:13765:1875765554692096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788869644.539066:0:13765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869644.539079:0:13765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869644.539081:0:13765:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788869644.539092:0:13765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788869644.542822:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788869644.542870:0:6481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788869644.542885:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2ef1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2ef8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869644.542898:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2ef1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2ef8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869644.698843:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554692224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869644.699038:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869644.699121:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554692352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869644.699149:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869644.699217:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554692352 00000100:00100000:0.0:1788869644.699217:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554692224 00000100:00100000:1.0:1788869644.699225:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554692352 00000100:00100000:0.0:1788869644.699225:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554692224 00000100:00100000:1.0:1788869644.699285:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788869644.699291:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788869644.699297:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554692224:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869644.699307:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554692352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869644.699334:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00002000:00000024:0.0:1788869644.699334:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869644.699384:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554692224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869644.699386:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554692352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869644.699392:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788869644.699392:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1788869644.699533:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788869644.699564:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839bfb80 x1875765554692224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869660 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869644.699583:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554692224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869644.699595:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554692352:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869645.208556:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869645.208930:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554692608:0@lo:400:kworker.0 00000100:00100000:2.0:1788869645.209006:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869645.209288:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554692480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869645.209366:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869645.209489:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554692480 00000100:00100000:3.0:1788869645.209497:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554692480 00000100:00100000:3.0:1788869645.209561:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788869645.209571:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554692480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869645.209592:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869645.209648:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554692480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869645.209672:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:3.0:1788869645.209715:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83a33b80 x1875765554692480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869661 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869645.209736:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554692480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869645.209867:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554692864:0@lo:400:kworker.0 00000100:00100000:1.0:1788869645.209901:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869645.209922:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554693376:0@lo:400:kworker.0 00000100:00100000:1.0:1788869645.209966:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869645.209972:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554692736:0@lo:400:kworker.0 00000100:00100000:1.0:1788869645.209991:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554693888:0@lo:400:kworker.0 00000100:00100000:3.0:1788869645.210008:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869645.210043:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554692864 00000100:00100000:3.0:1788869645.210044:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554693248:0@lo:400:kworker.0 00000100:00100000:1.0:1788869645.210050:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554692864 00000100:00100000:3.0:1788869645.210077:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869645.210088:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788869645.210098:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554692864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869645.210103:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554693760:0@lo:400:kworker.0 00000100:00100000:3.0:1788869645.210130:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869645.210153:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554692864:12345-0@lo:400:kworker.0 Request processed in 56us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869645.210163:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788869645.210173:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554693376 00000100:00100000:3.0:1788869645.210178:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554693376 00000100:00100000:1.0:1788869645.210189:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554692736 00000100:00100000:1.0:1788869645.210194:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554692736 00000100:00100000:3.0:1788869645.210212:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554693248 00000100:00100000:3.0:1788869645.210218:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554693248 00000100:00100000:1.0:1788869645.210218:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554693760 00000100:00100000:1.0:1788869645.210224:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554693760 00000100:00100000:3.0:1788869645.210249:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788869645.210276:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788869645.210278:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875765554693376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869645.210289:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554692736:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788869645.210411:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869645.210415:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869645.210418:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869645.210440:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554692992:0@lo:400:kworker.0 00000100:00100000:1.0:1788869645.212473:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554692736:12345-0@lo:400:kworker.0 Request processed in 2174us (2452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869645.212487:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788869645.212521:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788869645.212533:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554693248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869645.212599:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554693248:12345-0@lo:400:kworker.0 Request processed in 71us (2522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869645.212606:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788869645.212621:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788869645.212628:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554693760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869645.212655:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554693760:12345-0@lo:400:kworker.0 Request processed in 29us (2525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869645.212661:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788869645.216499:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554692736:0@lo:400:kworker.0 00000100:00100000:1.0:1788869645.216513:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554693248:0@lo:400:kworker.0 00000100:00100000:1.0:1788869645.216521:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554693760:0@lo:400:kworker.0 00000100:00100000:1.0:1788869645.216561:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869645.216615:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554692864:0@lo:400:kworker.0 00000100:00100000:1.0:1788869645.216635:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554693888 00000100:00100000:1.0:1788869645.216641:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554693888 00000100:00100000:1.0:1788869645.216696:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788869645.216702:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875765554693888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869645.216758:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875765554693888:12345-0@lo:400:kworker.0 Request processed in 56us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869645.216763:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788869645.216785:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554693120:0@lo:400:kworker.0 00000100:00100000:1.0:1788869645.216810:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869645.216826:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554693632:0@lo:400:kworker.0 00000100:00100000:1.0:1788869645.216871:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869645.216893:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554693632 00000100:00100000:1.0:1788869645.216895:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554693632 00000100:00100000:1.0:1788869645.216923:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788869645.216928:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf901c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3617:x1875765554693632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869645.216954:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf901c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3617:x1875765554693632:12345-0@lo:400:kworker.0 Request processed in 26us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869645.216958:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788869645.216970:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554693120 00000100:00100000:1.0:1788869645.216972:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554693120 00000100:00100000:1.0:1788869645.216985:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788869645.216989:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554693120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869645.217008:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554693120:12345-0@lo:400:kworker.0 Request processed in 19us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869645.217011:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:1.0:1788869645.217029:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839bd500 x1875765554693888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869645.217037:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554693888:0@lo:400:kworker.0 00000100:00100000:1.0:1788869645.217048:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554693120:0@lo:400:kworker.0 00000100:00100000:1.0:1788869645.217054:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554693632:0@lo:400:kworker.0 00000100:00080000:1.0:1788869645.217164:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869645.217168:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869645.220144:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875765554693376:12345-0@lo:400:kworker.0 Request processed in 9849us (10157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869645.220168:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00010000:00080000:3.0:1788869645.220226:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839be680 x1875765554693376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869645.220243:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554693376:0@lo:400:kworker.0 00000100:00100000:2.0:1788869645.221028:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869645.221069:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554693504:0@lo:400:kworker.0 00000100:00100000:2.0:1788869645.221102:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869645.221216:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554692992 00000100:00100000:1.0:1788869645.221224:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554692992 00000100:00100000:1.0:1788869645.221292:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788869645.221302:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554692992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869645.225004:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554693504 00000100:00100000:3.0:1788869645.225018:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554693504 00000100:00100000:3.0:1788869645.225112:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788869645.225122:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554693504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869645.225216:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554693504:12345-0@lo:400:kworker.0 Request processed in 95us (4112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869645.225223:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1788869645.225247:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869645.225423:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554694016:0@lo:400:kworker.0 00000100:00100000:2.0:1788869645.225472:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869645.225527:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554693504:0@lo:400:kworker.0 00000100:00100000:1.0:1788869645.225709:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554692992:12345-0@lo:400:kworker.0 Request processed in 4407us (4682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869645.225719:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788869645.225836:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554692992:0@lo:400:kworker.0 00000100:00100000:3.0:1788869645.225981:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554694016 00000100:00100000:3.0:1788869645.225986:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554694016 00000100:00100000:3.0:1788869645.226022:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788869645.226030:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554694016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869645.226075:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554694016:12345-0@lo:400:kworker.0 Request processed in 46us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869645.226082:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:2.0:1788869645.226240:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839bf480 x1875765554694016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869645.226275:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554694016:0@lo:400:kworker.0 00000100:00100000:0.0:1788869645.242653:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554692608 00000100:00100000:0.0:1788869645.242671:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554692608 00000100:00100000:2.0:1788869645.242781:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1788869645.242790:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554692608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869645.243013:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554692608:12345-0@lo:400:kworker.0 Request processed in 224us (34007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869645.243019:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788869645.243080:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554692608:0@lo:400:kworker.0 00010000:00010000:1.0:1788869645.338557:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788869645.529171:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788869645.531675:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788869646.360474:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869646.955590:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869646.955654:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869646.955684:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869646.955731:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869646.955756:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869646.955792:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869646.955815:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545169152 00000100:00100000:0.0:1788869646.955820:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545169024 00000100:00100000:2.0:1788869646.955828:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545169152 00000100:00100000:0.0:1788869646.955828:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545169024 00000100:00100000:2.0:1788869646.955889:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545169664 00000100:00100000:2.0:1788869646.955894:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545169664 00000100:00100000:2.0:1788869646.955909:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545169280 00000100:00100000:0.0:1788869646.955909:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 368 00000100:00100000:2.0:1788869646.955913:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545169280 00000100:00100000:0.0:1788869646.955925:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2387:x1875765545169024:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869646.955931:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545169536 00000100:00100000:2.0:1788869646.955935:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545169536 00000100:00100000:2.0:1788869646.955949:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 229 00000100:00100000:2.0:1788869646.955958:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545169152:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869646.956062:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 230 00000100:00100000:1.0:1788869646.956073:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545169664:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869646.956139:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545169408 00000100:00100000:3.0:1788869646.956143:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545169408 00000100:00100000:3.0:1788869646.956182:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93 00000100:00100000:3.0:1788869646.956188:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545169408:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869646.956230:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2387:x1875765545169024:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 84us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869646.956238:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 368 00000100:00100000:2.0:1788869646.963077:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545169152:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 7106us (7486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869646.963080:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545169664:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 7005us (7391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869646.963099:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 229 00000100:00100000:3.0:1788869646.963134:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545169408:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 6942us (7476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869646.963156:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93 00000100:00100000:1.0:1788869646.963440:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 230 00000100:00100000:1.0:1788869646.963460:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 231 00000100:00100000:1.0:1788869646.963474:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545169280:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869646.963540:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545169280:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 72us (7783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869646.963546:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 231 00000100:00100000:0.0:1788869646.966595:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 232 00000100:00100000:0.0:1788869646.966617:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545169536:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869646.966708:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545169536:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 100us (10916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869646.966716:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 232 00000100:00080000:0.0:1788869646.966881:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788869646.966887:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869646.966889:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869647.256899:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869647.256927:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554694144:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869647.257020:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869647.257599:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554694144 00000100:00100000:3.0:1788869647.257610:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554694144 00000100:00100000:3.0:1788869647.257697:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788869647.257708:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554694144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869647.257758:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869647.257812:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554694144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869647.257818:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1788869647.257869:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869647.261283:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554694272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869647.261416:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869647.261526:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554694272 00000100:00100000:2.0:1788869647.261533:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554694272 00000100:00100000:2.0:1788869647.261600:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788869647.261609:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1875765554694272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869647.261637:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869647.261680:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1875765554694272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869647.261687:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788869647.261734:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554694144:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788869647.261852:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869647.261875:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554694272:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788869647.384643:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869647.768483:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554694400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869647.768565:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869647.768717:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554694400 00000100:00100000:2.0:1788869647.768723:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554694400 00000100:00100000:2.0:1788869647.768826:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788869647.768834:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554694400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869647.768865:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869647.771522:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554694400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2676us (2944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869647.771536:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788869647.771675:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554694400:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788869648.408593:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869649.433780:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869649.816911:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554694528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869649.816974:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869649.817491:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554694528 00000100:00100000:2.0:1788869649.817500:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554694528 00000100:00100000:2.0:1788869649.817551:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788869649.817560:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554694528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869649.817593:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788869649.817651:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554694528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869649.817658:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788869649.817706:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554694528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869649.818062:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869649.818072:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554694656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869649.818103:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869649.818127:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554694656 00000100:00100000:0.0:1788869649.818131:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554694656 00000100:00100000:0.0:1788869649.818166:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788869649.818172:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554694656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869649.818203:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869649.818246:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554694656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869649.818287:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1788869649.818320:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788869649.818344:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83a30e00 x1875765554694656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869665 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869649.818371:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554694656:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788869649.819099:0:8393:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1788869650.328712:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554694784:0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.328806:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869650.328858:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554695296:0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.328897:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869650.328936:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554695808:0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.328970:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869650.328986:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554696320:0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.329006:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869650.329029:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788869650.329035:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554694912:0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.329059:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869650.329081:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554695424:0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.329103:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869650.329116:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554695936:0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.329133:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869650.329156:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554695168:0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.329177:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869650.329190:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554695680:0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.329208:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869650.329219:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554696192:0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.329236:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869650.329249:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788869650.329274:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554695040:0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.329294:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869650.329312:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554695552:0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.329332:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869650.329344:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554696064:0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.329385:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869650.329419:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554695296 00000100:00100000:1.0:1788869650.329426:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554695296 00000100:00100000:1.0:1788869650.329466:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554695040 00000100:00100000:1.0:1788869650.329470:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554695040 00000100:00100000:1.0:1788869650.329486:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788869650.329493:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554695296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.329551:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554695296:12345-0@lo:400:kworker.0 Request processed in 57us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869650.329558:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788869650.329574:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788869650.329579:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554695040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.329611:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554695040:12345-0@lo:400:kworker.0 Request processed in 32us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869650.329617:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788869650.329634:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554695808 00000100:00100000:1.0:1788869650.329638:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554695808 00000100:00100000:1.0:1788869650.329669:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554696320 00000100:00100000:1.0:1788869650.329672:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554696320 00000100:00100000:1.0:1788869650.329680:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554695680 00000100:00100000:1.0:1788869650.329682:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554695680 00000100:00100000:1.0:1788869650.329693:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554696192 00000100:00100000:1.0:1788869650.329695:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554696192 00000100:00100000:1.0:1788869650.329708:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788869650.329713:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554695808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.329742:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554695808:12345-0@lo:400:kworker.0 Request processed in 28us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869650.329747:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788869650.329757:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788869650.329762:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554696320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.329810:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554696320:12345-0@lo:400:kworker.0 Request processed in 48us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869650.329816:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788869650.329826:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788869650.329831:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554695680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.329853:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554695680:12345-0@lo:400:kworker.0 Request processed in 22us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869650.329858:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788869650.329868:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788869650.329873:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554696192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.329897:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554696192:12345-0@lo:400:kworker.0 Request processed in 25us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869650.329903:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788869650.329940:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554695040:0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.329952:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554695680:0@lo:400:kworker.0 00010000:00080000:1.0:1788869650.329964:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839cb480 x1875765554696192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869650.329974:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554696192:0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.330022:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554695296:0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.330029:0:3618:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788869650.330034:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fe82325f80, transno 4294967301 00000100:00100000:1.0:1788869650.330044:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554695808:0@lo:400:kworker.0 00010000:00080000:1.0:1788869650.330052:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839c8e00 x1875765554696320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869650.330066:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554696320:0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.330185:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554694912 00000100:00100000:1.0:1788869650.330189:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554694912 00000100:00100000:1.0:1788869650.330207:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554695424 00000100:00100000:1.0:1788869650.330209:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554695424 00000100:00100000:1.0:1788869650.330220:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554695936 00000100:00100000:1.0:1788869650.330223:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554695936 00000100:00100000:1.0:1788869650.330232:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554695168 00000100:00100000:1.0:1788869650.330235:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554695168 00000100:00100000:1.0:1788869650.330242:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554695552 00000100:00100000:1.0:1788869650.330244:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554695552 00000100:00100000:1.0:1788869650.330279:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554696064 00000100:00100000:1.0:1788869650.330282:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554696064 00000100:00100000:1.0:1788869650.330295:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788869650.330300:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554694912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.330337:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554694912:12345-0@lo:400:kworker.0 Request processed in 36us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869650.330342:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788869650.330368:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788869650.330374:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554695424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.330402:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554695424:12345-0@lo:400:kworker.0 Request processed in 29us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869650.330408:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788869650.330419:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788869650.330424:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554695936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.330448:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554695936:12345-0@lo:400:kworker.0 Request processed in 24us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869650.330462:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788869650.330473:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788869650.330478:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554695168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.330511:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554695168:12345-0@lo:400:kworker.0 Request processed in 32us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869650.330516:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788869650.330526:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788869650.330532:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554695552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.330557:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554695552:12345-0@lo:400:kworker.0 Request processed in 25us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869650.330562:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788869650.330572:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788869650.330578:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875765554696064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.330602:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875765554696064:12345-0@lo:400:kworker.0 Request processed in 24us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869650.330607:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00010000:00080000:1.0:1788869650.330632:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8222aa00 x1875765554695552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869650.330641:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554695552:0@lo:400:kworker.0 00010000:00080000:1.0:1788869650.330651:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839cbb80 x1875765554696064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869650.330659:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554696064:0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.330669:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554695168:0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.330705:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554694912:0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.330715:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554695424:0@lo:400:kworker.0 00000100:00100000:1.0:1788869650.330724:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554695936:0@lo:400:kworker.0 00000100:00100000:3.0:1788869650.331114:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554694784 00000100:00100000:3.0:1788869650.331120:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554694784 00000100:00100000:3.0:1788869650.331163:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788869650.331170:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554694784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869650.331216:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554694784:12345-0@lo:400:kworker.0 Request processed in 47us (2411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869650.331221:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788869650.331292:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554694784:0@lo:400:kworker.0 00000100:00080000:0.0:1788869650.339380:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869650.339388:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869650.339390:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869650.339393:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869650.339482:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869650.339504:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554696448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869650.339577:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869650.339791:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554696448 00000100:00100000:0.0:1788869650.339799:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554696448 00000100:00100000:0.0:1788869650.339861:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788869650.339871:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554696448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869650.339896:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869650.339950:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554696448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869650.339966:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:3.0:1788869650.340096:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfa61880 x1875765554696448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869650.340116:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554696448:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788869650.456861:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869651.481371:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869652.075111:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869652.075182:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869652.075222:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869652.075244:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869652.075296:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869652.075320:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869652.075348:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545170048 00000100:00100000:3.0:1788869652.075368:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545170048 00000100:00100000:3.0:1788869652.075427:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545170304 00000100:00100000:3.0:1788869652.075431:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545170304 00000100:00100000:3.0:1788869652.075445:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545169920 00000100:00100000:3.0:1788869652.075448:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545169920 00000100:00100000:3.0:1788869652.075461:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545170432 00000100:00100000:3.0:1788869652.075463:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545170432 00000100:00100000:3.0:1788869652.075478:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 239 00000100:00100000:3.0:1788869652.075489:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545170048:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869652.075702:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 240 00000100:00100000:2.0:1788869652.075713:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545170304:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869652.075785:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545170304:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 74us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869652.075792:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 240 00000100:00100000:2.0:1788869652.075811:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 241 00000100:00100000:2.0:1788869652.075817:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545169920:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869652.075842:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545169920:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869652.075848:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 241 00000100:00100000:2.0:1788869652.075859:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 242 00000100:00100000:2.0:1788869652.075866:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545170432:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869652.075890:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545170432:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869652.075907:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 242 00000100:00080000:2.0:1788869652.075942:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869652.075946:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869652.077298:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545169792 00000100:00100000:1.0:1788869652.077308:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545169792 00000100:00100000:3.0:1788869652.077646:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545170048:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 2155us (2460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869652.077656:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 239 00000100:00100000:1.0:1788869652.079264:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 370 00000100:00100000:1.0:1788869652.079286:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8893a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2389:x1875765545169792:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869652.079347:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8893a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2389:x1875765545169792:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 71us (4246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869652.079364:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 370 00000100:00100000:0.0:1788869652.079833:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545170176 00000100:00100000:0.0:1788869652.079842:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545170176 00000100:00100000:0.0:1788869652.079904:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 98 00000100:00100000:0.0:1788869652.079911:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545170176:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869652.079951:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545170176:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 41us (4655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869652.079976:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 98 00000100:00080000:3.0:1788869652.081913:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869652.385080:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869652.385104:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554696576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869652.385174:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869652.385839:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554696576 00000100:00100000:0.0:1788869652.385849:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554696576 00000100:00100000:0.0:1788869652.385919:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788869652.385931:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554696576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869652.385961:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869652.386013:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554696576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869652.386022:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788869652.386211:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869652.386225:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554696704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869652.386282:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788869652.386377:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869652.386415:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554696576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869652.386488:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554696704 00000100:00100000:3.0:1788869652.386492:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554696704 00000100:00100000:3.0:1788869652.386532:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788869652.386539:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554696704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869652.386550:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869652.386587:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554696704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869652.386593:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788869652.386676:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554696704:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788869652.386833:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788869652.504598:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869652.888829:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869652.888853:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554696832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869652.888943:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869652.889118:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554696832 00000100:00100000:1.0:1788869652.889127:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554696832 00000100:00100000:1.0:1788869652.889182:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788869652.889192:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf95a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554696832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788869652.889235:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788869652.889312:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf95a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554696832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869652.889319:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788869652.889474:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554696832:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788869653.531907:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869654.552780:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869654.936861:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554696960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869654.936942:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869654.938683:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554696960 00000100:00100000:2.0:1788869654.938695:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554696960 00000100:00100000:2.0:1788869654.938758:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788869654.938767:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554696960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869654.938806:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788869654.938881:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554696960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (1939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869654.938888:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788869654.939568:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554696960:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869654.940079:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869654.940093:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554697088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869654.940140:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869654.946052:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554697088 00000100:00100000:3.0:1788869654.946067:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554697088 00000100:00100000:3.0:1788869654.946172:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788869654.946184:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554697088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788869654.946219:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869654.946373:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554697088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 191us (6230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869654.946381:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:3.0:1788869654.946436:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83835500 x1875765554697088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869670 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869654.946458:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554697088:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788869654.947547:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869655.448706:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554697472:0@lo:400:kworker.0 00000100:00100000:2.0:1788869655.448779:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869655.448832:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554697984:0@lo:400:kworker.0 00000100:00100000:2.0:1788869655.448856:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869655.448883:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554698496:0@lo:400:kworker.0 00000100:00100000:2.0:1788869655.448903:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869655.448927:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788869655.448933:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554697344:0@lo:400:kworker.0 00000100:00100000:2.0:1788869655.448951:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869655.448964:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554697856:0@lo:400:kworker.0 00000100:00100000:2.0:1788869655.448981:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869655.448999:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875765554698368:0@lo:400:kworker.0 00000100:00100000:2.0:1788869655.449033:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869655.449059:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554697472 00000100:00100000:2.0:1788869655.449065:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554697472 00000100:00100000:2.0:1788869655.449109:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788869655.449117:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554697472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869655.449163:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554697472:12345-0@lo:400:kworker.0 Request processed in 46us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869655.449170:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788869655.449189:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554697984 00000100:00100000:2.0:1788869655.449191:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554697984 00000100:00100000:2.0:1788869655.449215:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554698496 00000100:00100000:2.0:1788869655.449216:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554698496 00000100:00100000:2.0:1788869655.449228:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554697344 00000100:00100000:2.0:1788869655.449230:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554697344 00000100:00100000:2.0:1788869655.449240:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554697856 00000100:00100000:2.0:1788869655.449242:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554697856 00000100:00100000:2.0:1788869655.449281:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554698368 00000100:00100000:2.0:1788869655.449284:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554698368 00000100:00100000:2.0:1788869655.449298:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788869655.449303:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875765554697984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869655.449331:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875765554697984:12345-0@lo:400:kworker.0 Request processed in 27us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869655.449337:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788869655.449347:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788869655.449352:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875765554698496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869655.449388:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875765554698496:12345-0@lo:400:kworker.0 Request processed in 36us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869655.449394:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788869655.449411:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788869655.449416:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554697344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869655.449437:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554697344:12345-0@lo:400:kworker.0 Request processed in 22us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869655.449443:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788869655.449451:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788869655.449456:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554697856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869655.449476:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554697856:12345-0@lo:400:kworker.0 Request processed in 19us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869655.449481:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788869655.449489:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788869655.449494:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875765554698368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869655.449513:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875765554698368:12345-0@lo:400:kworker.0 Request processed in 19us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869655.449518:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:2.0:1788869655.449543:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869655.449546:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869655.449573:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554697344:0@lo:400:kworker.0 00000100:00100000:2.0:1788869655.449583:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554697856:0@lo:400:kworker.0 00000100:00100000:2.0:1788869655.449590:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875765554698368:0@lo:400:kworker.0 00000100:00100000:2.0:1788869655.449599:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554697472:0@lo:400:kworker.0 00010000:00080000:2.0:1788869655.449609:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffb8912a00 x1875765554697984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869655.449619:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554697984:0@lo:400:kworker.0 00010000:00080000:2.0:1788869655.449634:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83086300 x1875765554698496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869655.449642:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554698496:0@lo:400:kworker.0 00000100:00100000:3.0:1788869655.449732:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554697216:0@lo:400:kworker.0 00000100:00100000:3.0:1788869655.449766:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869655.449803:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554697728:0@lo:400:kworker.0 00000100:00100000:3.0:1788869655.449824:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869655.449837:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554698240:0@lo:400:kworker.0 00000100:00100000:3.0:1788869655.449856:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869655.449871:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554698752:0@lo:400:kworker.0 00000100:00100000:3.0:1788869655.449888:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869655.449903:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788869655.449908:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554697600:0@lo:400:kworker.0 00000100:00100000:3.0:1788869655.449925:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869655.449936:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554698112:0@lo:400:kworker.0 00000100:00100000:3.0:1788869655.449952:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869655.449966:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554698624:0@lo:400:kworker.0 00000100:00100000:3.0:1788869655.449991:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869655.450014:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554698240 00000100:00100000:3.0:1788869655.450018:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554698240 00000100:00100000:3.0:1788869655.450041:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554698752 00000100:00100000:3.0:1788869655.450044:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554698752 00000100:00100000:3.0:1788869655.450053:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554698112 00000100:00100000:3.0:1788869655.450054:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554698112 00000100:00100000:3.0:1788869655.450062:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554698624 00000100:00100000:3.0:1788869655.450064:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554698624 00000100:00100000:3.0:1788869655.450076:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788869655.450082:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554698240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869655.450118:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554698240:12345-0@lo:400:kworker.0 Request processed in 36us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869655.450124:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788869655.450136:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788869655.450141:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554698752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869655.450163:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554698752:12345-0@lo:400:kworker.0 Request processed in 23us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869655.450168:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788869655.450176:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788869655.450181:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554698112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869655.450201:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554698112:12345-0@lo:400:kworker.0 Request processed in 20us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869655.450206:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788869655.450215:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788869655.450220:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554698624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869655.450243:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554698624:12345-0@lo:400:kworker.0 Request processed in 23us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869655.450282:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1788869655.450310:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869655.450314:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869655.450334:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554698112:0@lo:400:kworker.0 00010000:00080000:3.0:1788869655.450344:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83087100 x1875765554698624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869655.450351:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554698624:0@lo:400:kworker.0 00000100:00100000:3.0:1788869655.450374:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554698240:0@lo:400:kworker.0 00010000:00080000:3.0:1788869655.450384:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83085500 x1875765554698752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869655.450392:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554698752:0@lo:400:kworker.0 00000100:00100000:1.0:1788869655.450501:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554697728 00000100:00100000:1.0:1788869655.450506:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554697728 00000100:00100000:1.0:1788869655.450543:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788869655.450561:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554697728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869655.450603:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554697728:12345-0@lo:400:kworker.0 Request processed in 43us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869655.450610:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788869655.450642:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554697728:0@lo:400:kworker.0 00000100:00100000:2.0:1788869655.450946:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554697216 00000100:00100000:2.0:1788869655.450951:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554697216 00000100:00100000:2.0:1788869655.451017:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788869655.451025:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff85f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554697216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869655.451067:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff85f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554697216:12345-0@lo:400:kworker.0 Request processed in 44us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869655.451074:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1788869655.451135:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554697216:0@lo:400:kworker.0 00000100:00100000:0.0:1788869655.451544:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554697600 00000100:00100000:0.0:1788869655.451549:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554697600 00000100:00100000:0.0:1788869655.451573:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788869655.451579:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554697600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869655.451618:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554697600:12345-0@lo:400:kworker.0 Request processed in 39us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869655.451624:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788869655.451638:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869655.451648:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554698880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869655.451677:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869655.451720:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554698880 00000100:00100000:0.0:1788869655.451723:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554698880 00000100:00100000:0.0:1788869655.451759:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788869655.451764:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554698880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869655.451779:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869655.451808:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554698880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869655.451814:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:0.0:1788869655.451839:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfa60e00 x1875765554698880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869655.451853:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554698880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869655.451953:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554697600:0@lo:400:kworker.0 00010000:00010000:3.0:1788869655.577911:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869655.769114:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788869655.769872:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788869656.601569:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869657.205452:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869657.205494:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869657.205522:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545170688 00000100:00100000:0.0:1788869657.205528:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869657.205534:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545170688 00000100:00100000:0.0:1788869657.205568:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869657.205602:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545170816 00000100:00100000:0.0:1788869657.205604:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545171072 00000100:00100000:2.0:1788869657.205607:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545170816 00000100:00100000:0.0:1788869657.205610:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545171072 00000100:00100000:2.0:1788869657.205638:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 249 00000100:00100000:2.0:1788869657.205648:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545170688:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869657.205722:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545170688:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 75us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869657.205729:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 249 00000100:00100000:1.0:1788869657.205833:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545170560 00000100:00100000:1.0:1788869657.205839:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545170560 00000100:00100000:1.0:1788869657.205871:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 372 00000100:00100000:1.0:1788869657.205878:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2389:x1875765545170560:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869657.205909:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2389:x1875765545170560:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 31us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869657.205916:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 372 00000100:00100000:0.0:1788869657.210476:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 250 00000100:00100000:2.0:1788869657.210490:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 251 00000100:00100000:0.0:1788869657.210514:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545170816:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869657.210600:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545171072:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869657.210602:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545170816:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 109us (5072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869657.210614:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 250 00000100:00100000:2.0:1788869657.210634:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545171072:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 135us (5065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869657.210639:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 251 00000100:00080000:2.0:1788869657.210695:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869657.210699:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869657.211830:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869657.211870:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869657.211880:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545170944 00000100:00100000:2.0:1788869657.211890:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545170944 00000100:00100000:1.0:1788869657.211913:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545171200 00000100:00100000:1.0:1788869657.211918:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545171200 00000100:00100000:1.0:1788869657.211962:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 252 00000100:00100000:2.0:1788869657.211965:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 103 00000100:00100000:2.0:1788869657.211979:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545170944:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:0.0:1788869657.211983:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869657.211984:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545171200:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:0.0:1788869657.211989:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869657.212024:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545171200:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 45us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869657.212029:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 252 00000100:00100000:2.0:1788869657.212035:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545170944:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 59us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869657.212047:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 103 00000100:00100000:1.0:1788869657.496581:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869657.496603:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554699008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869657.496675:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869657.496796:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554699008 00000100:00100000:0.0:1788869657.496806:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554699008 00000100:00100000:0.0:1788869657.496897:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788869657.496906:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554699008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869657.496935:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869657.496973:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554699008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869657.496979:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1788869657.497041:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869657.497085:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554699008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869657.497457:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554699136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869657.497497:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869657.497844:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554699136 00000100:00100000:0.0:1788869657.497849:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554699136 00000100:00100000:0.0:1788869657.497939:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788869657.497946:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554699136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788869657.497963:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788869657.498013:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869657.498188:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554699136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 241us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869657.498193:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788869657.498312:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554699136:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788869657.629114:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869658.010040:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869658.010078:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554699264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869658.010153:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869658.010973:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554699264 00000100:00100000:0.0:1788869658.010980:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554699264 00000100:00100000:0.0:1788869658.011021:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788869658.011027:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554699264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869658.011058:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788869658.011117:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554699264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869658.011123:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788869658.011166:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554699264:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788869658.648542:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869659.672599:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869660.056528:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffac4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554699392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869660.056598:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869660.056719:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554699392 00000100:00100000:3.0:1788869660.056727:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554699392 00000100:00100000:3.0:1788869660.056783:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788869660.056792:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554699392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788869660.056822:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869660.056872:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554699392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869660.056892:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1788869660.057040:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869660.057151:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554699520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869660.057186:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869660.057278:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554699520 00000100:00100000:3.0:1788869660.057282:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554699520 00000100:00100000:3.0:1788869660.057316:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788869660.057323:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554699520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869660.057347:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788869660.057409:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554699520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869660.057415:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788869660.057497:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554699520:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1788869660.059477:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffac4edc00 x1875765554699392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869660.059501:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffac4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554699392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869660.569624:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554699648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869660.569704:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869660.570084:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554700032:0@lo:400:kworker.0 00000100:00100000:1.0:1788869660.570121:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869660.570150:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554700544:0@lo:400:kworker.0 00000100:00100000:1.0:1788869660.570176:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869660.570192:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554701056:0@lo:400:kworker.0 00000100:00100000:1.0:1788869660.570214:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869660.570236:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788869660.570242:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554699904:0@lo:400:kworker.0 00000100:00100000:1.0:1788869660.570295:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869660.570476:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554700160:0@lo:400:kworker.0 00000100:00100000:2.0:1788869660.570544:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554699776:0@lo:400:kworker.0 00000100:00100000:0.0:1788869660.570616:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554699648 00000100:00100000:0.0:1788869660.570624:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554699648 00000100:00100000:0.0:1788869660.570699:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788869660.570709:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554699648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869660.570731:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869660.570847:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869660.570877:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554700672:0@lo:400:kworker.0 00000100:00100000:3.0:1788869660.570903:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869660.570920:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554701184:0@lo:400:kworker.0 00000100:00100000:3.0:1788869660.570939:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869660.570964:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554700672 00000100:00100000:3.0:1788869660.570968:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554700672 00000100:00100000:3.0:1788869660.571002:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554701184 00000100:00100000:3.0:1788869660.571005:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554701184 00000100:00100000:3.0:1788869660.571023:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788869660.571029:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554700672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869660.571170:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554700672:12345-0@lo:400:kworker.0 Request processed in 139us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869660.571187:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788869660.571204:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788869660.571211:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554701184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869660.571242:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554701184:12345-0@lo:400:kworker.0 Request processed in 32us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869660.571248:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788869660.571409:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554700672:0@lo:400:kworker.0 00010000:00080000:3.0:1788869660.571425:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82cb7800 x1875765554701184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869660.571435:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554701184:0@lo:400:kworker.0 00000100:00100000:3.0:1788869660.571474:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554700544 00000100:00100000:3.0:1788869660.571479:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554700544 00000100:00100000:3.0:1788869660.571505:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554701056 00000100:00100000:3.0:1788869660.571509:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554701056 00000100:00100000:3.0:1788869660.571522:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554699904 00000100:00100000:3.0:1788869660.571525:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554699904 00000100:00100000:3.0:1788869660.571535:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554700160 00000100:00100000:3.0:1788869660.571538:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554700160 00000100:00100000:3.0:1788869660.571550:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788869660.571556:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875765554700544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869660.571591:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875765554700544:12345-0@lo:400:kworker.0 Request processed in 36us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869660.571599:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788869660.571610:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788869660.571616:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8208aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875765554701056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869660.571653:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8208aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875765554701056:12345-0@lo:400:kworker.0 Request processed in 38us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869660.571659:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788869660.571669:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788869660.571674:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554699904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869660.571701:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554699904:12345-0@lo:400:kworker.0 Request processed in 27us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869660.571706:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788869660.571715:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788869660.571720:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554700160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869660.571746:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554700160:12345-0@lo:400:kworker.0 Request processed in 26us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869660.571751:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788869660.571777:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554700160:0@lo:400:kworker.0 00000100:00100000:3.0:1788869660.571821:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554700032 00000100:00100000:3.0:1788869660.571824:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554700032 00000100:00100000:3.0:1788869660.571848:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788869660.571854:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554700032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869660.571886:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554700032:12345-0@lo:400:kworker.0 Request processed in 32us (1765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869660.571892:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1788869660.571926:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869660.571930:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869660.571932:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869660.572181:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554699904:0@lo:400:kworker.0 00000100:00100000:1.0:1788869660.572192:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554700416:0@lo:400:kworker.0 00000100:00100000:1.0:1788869660.572221:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869660.572265:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875765554700928:0@lo:400:kworker.0 00000100:00100000:1.0:1788869660.572288:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869660.572326:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554700032:0@lo:400:kworker.0 00010000:00080000:1.0:1788869660.572338:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82325f80 x1875765554700544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869660.572347:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554700544:0@lo:400:kworker.0 00010000:00080000:1.0:1788869660.572355:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8222b100 x1875765554701056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869660.572362:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554701056:0@lo:400:kworker.0 00000100:00100000:1.0:1788869660.572394:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554700416 00000100:00100000:1.0:1788869660.572398:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554700416 00000100:00100000:1.0:1788869660.572430:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554700928 00000100:00100000:1.0:1788869660.572433:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554700928 00000100:00100000:1.0:1788869660.572449:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788869660.572454:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554700416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869660.572489:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554700416:12345-0@lo:400:kworker.0 Request processed in 35us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869660.572494:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788869660.572505:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788869660.572509:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875765554700928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869660.572534:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875765554700928:12345-0@lo:400:kworker.0 Request processed in 24us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869660.572539:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:1.0:1788869660.572554:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869660.572569:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554700416:0@lo:400:kworker.0 00000100:00100000:1.0:1788869660.572588:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875765554700928:0@lo:400:kworker.0 00000100:00100000:2.0:1788869660.576835:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869660.576905:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554700288:0@lo:400:kworker.0 00000100:00100000:2.0:1788869660.576948:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869660.576985:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554700800:0@lo:400:kworker.0 00000100:00100000:2.0:1788869660.577008:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869660.577141:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554700288 00000100:00100000:3.0:1788869660.577149:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554700288 00000100:00100000:3.0:1788869660.577206:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788869660.577214:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554700288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869660.577281:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554700288:12345-0@lo:400:kworker.0 Request processed in 67us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869660.577287:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788869660.577337:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554700800 00000100:00100000:3.0:1788869660.577341:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554700800 00000100:00100000:3.0:1788869660.577383:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788869660.577389:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554700800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869660.577425:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554700800:12345-0@lo:400:kworker.0 Request processed in 36us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869660.577431:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788869660.577578:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554699776 00000100:00100000:1.0:1788869660.577582:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554699776 00000100:00100000:1.0:1788869660.577618:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1788869660.577624:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554699776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869660.577655:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554699776:12345-0@lo:400:kworker.0 Request processed in 32us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869660.577660:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00080000:1.0:1788869660.577684:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869660.577755:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554699776:0@lo:400:kworker.0 00000100:00100000:2.0:1788869660.577768:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554700288:0@lo:400:kworker.0 00000100:00100000:2.0:1788869660.577777:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554700800:0@lo:400:kworker.0 00000100:00100000:0.0:1788869660.579961:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554699648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 9245us (10248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869660.579975:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:3.0:1788869660.581028:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfa60700 x1875765554699648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869660.581069:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554699648:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788869660.701552:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869661.724346:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869662.314846:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869662.314941:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869662.314973:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869662.315021:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545171328 00000100:00100000:2.0:1788869662.315032:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545171328 00000100:00100000:1.0:1788869662.315100:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545171584 00000100:00100000:1.0:1788869662.315107:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545171584 00000100:00100000:2.0:1788869662.315126:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 374 00000100:00100000:2.0:1788869662.315138:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2389:x1875765545171328:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869662.315157:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545171456 00000100:00100000:1.0:1788869662.315162:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545171456 00000100:00100000:2.0:1788869662.315207:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2389:x1875765545171328:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 72us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869662.315213:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 374 00000100:00100000:3.0:1788869662.315285:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 259 00000100:00100000:3.0:1788869662.315303:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545171584:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869662.315307:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 260 00000100:00100000:0.0:1788869662.315319:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545171456:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869662.315366:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545171456:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 41us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869662.315402:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 260 00000100:00080000:0.0:1788869662.315427:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869662.315431:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869662.315759:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545171584:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 463us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869662.315768:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 259 00000100:00100000:0.0:1788869662.322364:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869662.325034:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545171712 00000100:00100000:3.0:1788869662.325053:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545171712 00000100:00100000:3.0:1788869662.325147:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:3.0:1788869662.325159:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2386:x1875765545171712:12345-192.168.201.30@tcp:9:kworker.0 00000020:00000080:3.0:1788869662.325212:0:8527:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2e1f 00000100:00080000:3.0:1788869662.325221:0:8527:0:(import.c:65:import_set_state_nolock()) ffff99fe83860000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788869662.325293:0:8527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:2.0:1788869662.325656:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788869662.325721:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869662.325970:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf4fff62-1855-4361-a244-1a23eb291d37+2:2386:x1875765545171712:12345-192.168.201.30@tcp:9:kworker.0 Request processed in 811us (3624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869662.325978:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:1.0:1788869662.326171:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869662.326327:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869662.326590:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545171840 00000100:00100000:2.0:1788869662.326598:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545171840 00000100:00080000:1.0:1788869662.326657:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869662.326661:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545171968 00000100:00100000:2.0:1788869662.326666:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545171968 00000100:00100000:2.0:1788869662.326696:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 261 00000100:00100000:1.0:1788869662.326705:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 262 00000100:00100000:2.0:1788869662.326707:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545171840:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869662.326719:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545171968:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869662.326781:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545171968:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 67us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869662.326788:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 262 00000100:00080000:1.0:1788869662.326807:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869662.326963:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545171840:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 258us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869662.326970:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 261 00000100:00100000:0.0:1788869662.616657:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869662.618874:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869662.618902:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554701440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869662.618902:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554701312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869662.620678:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869662.620735:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869662.620854:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554701440 00000100:00100000:1.0:1788869662.620863:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554701440 00000100:00100000:1.0:1788869662.620950:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554701312 00000100:00100000:1.0:1788869662.620953:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554701312 00000100:00080000:0.0:1788869662.620973:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869662.621045:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788869662.621055:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554701440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869662.621109:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869662.621161:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554701440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869662.621168:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788869662.621183:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788869662.621189:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554701312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869662.621201:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869662.621238:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554701312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869662.621244:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788869662.622917:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554701440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869662.623020:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554701312:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788869662.744683:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869663.128764:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554701568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869663.128842:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869663.128985:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554701568 00000100:00100000:0.0:1788869663.128995:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554701568 00000100:00100000:0.0:1788869663.129047:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788869663.129056:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554701568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869663.129104:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788869663.129177:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554701568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869663.129184:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788869663.129390:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554701568:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788869663.772273:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869664.796137:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869665.177492:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869665.177524:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554701696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869665.177622:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869665.177863:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554701696 00000100:00100000:3.0:1788869665.177875:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554701696 00000100:00100000:3.0:1788869665.177943:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788869665.177955:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554701696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869665.178002:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788869665.178064:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554701696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869665.178073:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788869665.178128:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554701696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869665.178591:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554701824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869665.178629:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869665.178729:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554701824 00000100:00100000:1.0:1788869665.178734:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554701824 00000100:00100000:1.0:1788869665.178793:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788869665.178803:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554701824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788869665.178831:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788869665.178895:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869665.179021:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554701824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 220us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869665.179028:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:3.0:1788869665.179082:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffb8912a00 x1875765554701824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869665.179099:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554701824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869665.689321:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554701952:0@lo:400:kworker.0 00000100:00100000:2.0:1788869665.689355:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554702208:0@lo:400:kworker.0 00000100:00100000:3.0:1788869665.689603:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869665.689679:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554702464:0@lo:400:kworker.0 00000100:00100000:3.0:1788869665.689708:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869665.689732:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554702976:0@lo:400:kworker.0 00000100:00100000:3.0:1788869665.689755:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869665.689800:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788869665.689807:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554702080:0@lo:400:kworker.0 00000100:00100000:3.0:1788869665.689832:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869665.689862:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554702592:0@lo:400:kworker.0 00000100:00100000:3.0:1788869665.689885:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869665.690364:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554701952 00000100:00100000:0.0:1788869665.690374:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554701952 00000100:00100000:0.0:1788869665.690458:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1788869665.690469:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554701952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869665.690538:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554701952:12345-0@lo:400:kworker.0 Request processed in 71us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869665.690547:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1788869665.691054:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875765554703104:0@lo:400:kworker.0 00000100:00100000:3.0:1788869665.691091:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869665.691199:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554701952:0@lo:400:kworker.0 00000100:00100000:3.0:1788869665.691240:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554702336:0@lo:400:kworker.0 00000100:00100000:3.0:1788869665.691288:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869665.691312:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554702848:0@lo:400:kworker.0 00000100:00100000:3.0:1788869665.691337:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869665.691357:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554703360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869665.691394:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869665.693047:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869665.696963:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554702720:0@lo:400:kworker.0 00000100:00100000:2.0:1788869665.697420:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869665.697460:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff8729b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554703232:0@lo:400:kworker.0 00000100:00100000:2.0:1788869665.697489:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869665.697689:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554702464 00000100:00100000:0.0:1788869665.697702:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554702464 00000100:00100000:0.0:1788869665.698076:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554702976 00000100:00100000:0.0:1788869665.698081:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554702976 00000100:00100000:2.0:1788869665.698095:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554702848 00000100:00100000:2.0:1788869665.698099:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554702848 00000100:00100000:3.0:1788869665.698142:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554702080 00000100:00100000:3.0:1788869665.698146:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554702080 00000100:00100000:3.0:1788869665.698172:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554702592 00000100:00100000:3.0:1788869665.698175:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554702592 00000100:00080000:1.0:1788869665.698276:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869665.698283:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869665.698285:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869665.698387:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554703104 00000100:00100000:0.0:1788869665.698393:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554703104 00000100:00100000:0.0:1788869665.698409:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554702208 00000100:00100000:0.0:1788869665.698412:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554702208 00000100:00100000:0.0:1788869665.698431:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788869665.698452:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff87299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554702464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869665.698547:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff87299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554702464:12345-0@lo:400:kworker.0 Request processed in 97us (8837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869665.698555:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788869665.698573:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788869665.698579:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff87299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554702080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869665.698594:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554702720 00000100:00100000:2.0:1788869665.698598:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554702720 00000100:00100000:0.0:1788869665.698611:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff87299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554702080:12345-0@lo:400:kworker.0 Request processed in 32us (8778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869665.698617:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788869665.698618:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554703232 00000100:00100000:2.0:1788869665.698621:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554703232 00000100:00100000:2.0:1788869665.698635:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788869665.698640:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff87299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554702848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869665.698645:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788869665.698650:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8729a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554702976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869665.698676:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8729a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554702976:12345-0@lo:400:kworker.0 Request processed in 26us (8920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869665.698679:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff87299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554702848:12345-0@lo:400:kworker.0 Request processed in 39us (7341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869665.698683:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788869665.698685:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788869665.698693:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788869665.698694:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788869665.698699:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554702720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869665.698699:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8729bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875765554703104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869665.698726:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8729bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875765554703104:12345-0@lo:400:kworker.0 Request processed in 28us (7635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869665.698733:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788869665.698745:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788869665.698751:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554702208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869665.699119:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788869665.699127:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff87298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554702592:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788869665.699543:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869665.699548:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869665.699551:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869665.700625:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554702720:12345-0@lo:400:kworker.0 Request processed in 1918us (3200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869665.700637:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788869665.700652:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff87298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554702592:12345-0@lo:400:kworker.0 Request processed in 1525us (10766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869665.700671:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788869665.700673:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788869665.700680:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554703232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869665.700719:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554702336 00000100:00100000:3.0:1788869665.700728:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554702336 00000100:00100000:3.0:1788869665.700767:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788869665.700774:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8729b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554702336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869665.700834:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8729b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554702336:12345-0@lo:400:kworker.0 Request processed in 60us (9544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869665.700850:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788869665.700876:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554703360 00000100:00100000:3.0:1788869665.700881:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554703360 00000100:00100000:3.0:1788869665.700928:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788869665.700935:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff87299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1875765554703360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869665.700953:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869665.700989:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff87299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1875765554703360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (9595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869665.700995:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788869665.701764:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554702208:12345-0@lo:400:kworker.0 Request processed in 3009us (8718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869665.701775:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788869665.703094:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554702080:0@lo:400:kworker.0 00010000:00080000:1.0:1788869665.703117:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82cb7800 x1875765554702592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869665.703129:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554702592:0@lo:400:kworker.0 00010000:00080000:1.0:1788869665.703142:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82229880 x1875765554703104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869665.703150:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875765554703104:0@lo:400:kworker.0 00000100:00100000:1.0:1788869665.703164:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554702464:0@lo:400:kworker.0 00000100:00100000:1.0:1788869665.703175:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554702976:0@lo:400:kworker.0 00000100:00100000:2.0:1788869665.705955:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554703232:12345-0@lo:400:kworker.0 Request processed in 5268us (8455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869665.705973:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788869665.706056:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554702336:0@lo:400:kworker.0 00000100:00100000:2.0:1788869665.706073:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554702848:0@lo:400:kworker.0 00010000:00080000:2.0:1788869665.706091:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfa48a80 x1875765554703360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869665.706115:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554703360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869665.718865:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554702208:0@lo:400:kworker.0 00000100:00100000:3.0:1788869665.719121:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554702720:0@lo:400:kworker.0 00010000:00080000:3.0:1788869665.719148:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ff8729b100 x1875765554703232/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869665.719159:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff8729b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554703232:0@lo:400:kworker.0 00010000:00010000:2.0:1788869665.816476:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788869666.009127:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788869666.009131:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788869666.844121:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869667.433788:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869667.433840:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869667.433864:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869667.433883:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869667.433905:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869667.433975:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545172096 00000100:00100000:3.0:1788869667.433984:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545172096 00000100:00100000:3.0:1788869667.434047:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 376 00000100:00100000:3.0:1788869667.434070:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8a775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2390:x1875765545172096:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869667.434143:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8a775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2390:x1875765545172096:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 74us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869667.434150:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 376 00000100:00100000:3.0:1788869667.434197:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545172352 00000100:00100000:3.0:1788869667.434201:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545172352 00000100:00100000:3.0:1788869667.434239:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545172608 00000100:00100000:3.0:1788869667.434243:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545172608 00000100:00100000:3.0:1788869667.434414:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545172224 00000100:00100000:3.0:1788869667.434418:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545172224 00000100:00100000:3.0:1788869667.434435:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545172480 00000100:00100000:3.0:1788869667.434437:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545172480 00000100:00100000:3.0:1788869667.434451:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 269 00000100:00100000:3.0:1788869667.434457:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545172352:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869667.434644:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545172352:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 185us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869667.434652:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 269 00000100:00100000:3.0:1788869667.434666:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 270 00000100:00100000:3.0:1788869667.434672:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545172608:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869667.434699:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545172608:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869667.434705:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 270 00000100:00100000:3.0:1788869667.434717:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 271 00000100:00100000:3.0:1788869667.434722:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545172224:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869667.434746:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545172224:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869667.434762:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 271 00000100:00100000:3.0:1788869667.434775:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 272 00000100:00100000:3.0:1788869667.434781:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545172480:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869667.434803:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545172480:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869667.434808:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 272 00000100:00080000:3.0:1788869667.434957:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869667.434962:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869667.738461:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869667.738484:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff8729b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554703488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869667.738552:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869667.738620:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554703488 00000100:00100000:3.0:1788869667.738628:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554703488 00000100:00100000:3.0:1788869667.738696:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788869667.738711:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8729ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554703488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869667.738740:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869667.738787:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8729ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554703488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869667.746109:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869667.746130:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554703616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869667.746283:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869667.746462:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788869667.746471:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1788869667.747213:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554703616 00000100:00100000:1.0:1788869667.747222:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554703616 00000100:00100000:1.0:1788869667.747564:0:13961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788869667.747576:0:13961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554703616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869667.747611:0:13961:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869667.747677:0:13961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554703616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869667.747685:0:13961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788869667.747729:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554703616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869667.748047:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1788869667.748070:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869667.748101:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff8729b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554703488:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788869667.864593:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869668.248731:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869668.248758:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554703744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869668.248832:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869668.249064:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554703744 00000100:00100000:1.0:1788869668.249073:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554703744 00000100:00100000:1.0:1788869668.249135:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788869668.249145:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554703744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788869668.249180:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788869668.249276:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554703744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869668.249284:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788869668.249430:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554703744:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1788869668.254952:0:8393:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bf4fff62-1855-4361-a244-1a23eb291d37 00000020:00000080:0.0:1788869668.254962:0:8393:0:(genops.c:906:class_export_put()) final put ffff99fe83862800/bf4fff62-1855-4361-a244-1a23eb291d37 00000020:00000080:2.0:1788869668.255302:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe83862800/bf4fff62-1855-4361-a244-1a23eb291d37 for lustre-OST0000 00000020:00000080:2.0:1788869668.255359:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99fe83860000 for lustre-OST0000 00010000:00010000:1.0:1788869668.888933:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788869669.507719:0:14023:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:14:28 (1788869668) 00010000:00010000:3.0:1788869669.912652:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869670.296679:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff8729b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554703872:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869670.296757:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869670.296979:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554703872 00000100:00100000:3.0:1788869670.296988:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554703872 00000100:00100000:3.0:1788869670.297059:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788869670.297068:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554703872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869670.297172:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788869670.297227:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554703872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 160us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869670.297234:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788869670.297562:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff8729b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554703872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869670.306203:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554704000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869670.306330:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869670.306540:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554704000 00000100:00100000:3.0:1788869670.306559:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554704000 00000100:00100000:3.0:1788869670.307504:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788869670.307520:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554704000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788869670.307555:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788869670.307854:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869670.316142:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554704000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8618us (9802us total) trans 0 rc 0/0 00010000:00080000:1.0:1788869670.316153:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839b9500 x1875765554704000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869670.316162:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788869670.316205:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554704000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869670.808790:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554704384:0@lo:400:kworker.0 00000100:00100000:0.0:1788869670.808864:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869670.808915:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554704896:0@lo:400:kworker.0 00000100:00100000:0.0:1788869670.808947:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869670.808963:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554705408:0@lo:400:kworker.0 00000100:00100000:0.0:1788869670.808980:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869670.808999:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788869670.809003:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875765554704256:0@lo:400:kworker.0 00000100:00100000:0.0:1788869670.809019:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869670.809029:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554704768:0@lo:400:kworker.0 00000100:00100000:0.0:1788869670.809044:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869670.809054:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554705280:0@lo:400:kworker.0 00000100:00100000:0.0:1788869670.809068:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869670.809157:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554704512:0@lo:400:kworker.0 00000100:00100000:1.0:1788869670.809188:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869670.809222:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554704512 00000100:00100000:1.0:1788869670.809230:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554704512 00000100:00100000:1.0:1788869670.809317:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788869670.809325:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554704512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869670.809376:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554704512:12345-0@lo:400:kworker.0 Request processed in 52us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869670.809398:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788869670.809434:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554704512:0@lo:400:kworker.0 00000100:00100000:1.0:1788869670.809440:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554705024:0@lo:400:kworker.0 00000100:00100000:1.0:1788869670.809459:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869670.809482:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788869670.809486:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554704128:0@lo:400:kworker.0 00000100:00100000:1.0:1788869670.809508:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869670.809528:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554704128 00000100:00100000:1.0:1788869670.809531:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554704128 00000100:00100000:1.0:1788869670.809550:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1788869670.809556:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8a777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554704128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869670.809580:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8a777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554704128:12345-0@lo:400:kworker.0 Request processed in 25us (71us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869670.809586:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1788869670.809616:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554704128:0@lo:400:kworker.0 00000100:00100000:1.0:1788869670.809622:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554704640:0@lo:400:kworker.0 00000100:00100000:1.0:1788869670.809640:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869670.809652:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554705152:0@lo:400:kworker.0 00000100:00100000:1.0:1788869670.809667:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869670.809848:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554704384 00000100:00100000:3.0:1788869670.809852:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554704384 00000100:00100000:3.0:1788869670.809873:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554704256 00000100:00100000:3.0:1788869670.809875:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554704256 00000100:00100000:3.0:1788869670.809883:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554704768 00000100:00100000:3.0:1788869670.809885:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554704768 00000100:00100000:3.0:1788869670.809911:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554705280 00000100:00100000:3.0:1788869670.809913:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554705280 00000100:00100000:3.0:1788869670.809922:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554704640 00000100:00100000:3.0:1788869670.809924:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554704640 00000100:00100000:3.0:1788869670.809933:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554705152 00000100:00100000:3.0:1788869670.809935:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554705152 00000100:00100000:3.0:1788869670.809946:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788869670.809951:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554704384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869670.809989:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554704384:12345-0@lo:400:kworker.0 Request processed in 37us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869670.810001:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788869670.810013:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788869670.810017:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875765554704256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869670.810039:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875765554704256:12345-0@lo:400:kworker.0 Request processed in 22us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869670.810044:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788869670.810052:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788869670.810057:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554704768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869670.810075:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554704768:12345-0@lo:400:kworker.0 Request processed in 19us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869670.810080:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788869670.810094:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788869670.810099:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875765554705280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869670.810120:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875765554705280:12345-0@lo:400:kworker.0 Request processed in 21us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869670.810126:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788869670.810138:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788869670.810144:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554704640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869670.810169:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554704640:12345-0@lo:400:kworker.0 Request processed in 26us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869670.810176:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788869670.810187:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788869670.810193:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554705152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869670.810226:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554705152:12345-0@lo:400:kworker.0 Request processed in 33us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869670.810237:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788869670.810336:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554704896 00000100:00100000:0.0:1788869670.810337:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875765554704256:0@lo:400:kworker.0 00010000:00080000:0.0:1788869670.810374:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfa49c00 x1875765554704768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869670.810395:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554704768:0@lo:400:kworker.0 00000100:00100000:3.0:1788869670.810399:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554704896 00010000:00080000:0.0:1788869670.810415:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfa49880 x1875765554705280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869670.810425:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554705280:0@lo:400:kworker.0 00000100:00100000:3.0:1788869670.810438:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554705408 00000100:00100000:3.0:1788869670.810444:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554705408 00000100:00100000:0.0:1788869670.810449:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554704384:0@lo:400:kworker.0 00000100:00100000:3.0:1788869670.810466:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554705024 00000100:00100000:3.0:1788869670.810473:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554705024 00000100:00100000:3.0:1788869670.810498:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788869670.810508:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554704896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869670.810520:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788869670.810539:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554705408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869670.810564:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554704896:12345-0@lo:400:kworker.0 Request processed in 57us (1614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869670.810572:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788869670.810588:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788869670.810598:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554705024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869670.810756:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869670.810770:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554705536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869670.810827:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554705024:12345-0@lo:400:kworker.0 Request processed in 231us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869670.810835:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788869670.810842:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554705408:12345-0@lo:400:kworker.0 Request processed in 308us (1857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869670.810854:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788869670.810960:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554704896:0@lo:400:kworker.0 00010000:00080000:0.0:1788869670.810973:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfa48380 x1875765554705408/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869670.810983:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554705408:0@lo:400:kworker.0 00000100:00080000:1.0:1788869670.812301:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869670.812309:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869670.812312:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869670.812314:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869670.812383:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554704640:0@lo:400:kworker.0 00000100:00100000:1.0:1788869670.812428:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554705152:0@lo:400:kworker.0 00000100:00100000:1.0:1788869670.812439:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554705024:0@lo:400:kworker.0 00000100:00100000:2.0:1788869670.819494:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869670.819726:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554705536 00000100:00100000:3.0:1788869670.819735:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554705536 00000100:00100000:3.0:1788869670.819785:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788869670.819794:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554705536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869670.819822:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869670.819885:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554705536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869670.819892:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:2.0:1788869670.819972:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfb1f480 x1875765554705536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869670.819993:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554705536:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788869670.936545:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869671.523164:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869671.523242:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545172736 00000100:00100000:3.0:1788869671.523291:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545172736 00000100:00100000:3.0:1788869671.523464:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:3.0:1788869671.523476:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:11065:x1875765545172736:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869671.523499:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869671.523523:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc2eff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa9eb expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788869671.523573:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788869671.523613:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc2f06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869671.523628:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc2f06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869671.523641:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc2f06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869671.523682:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788869671.523685:0:9496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869671.523717:0:9496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc2f06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869671.523736:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc2eff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9eb expref: 7 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869671.523749:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc2f06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9eb expref: 6 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869671.523755:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff8b125500) 00010000:00010000:3.0:1788869671.523757:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869671.523760:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9f400, rc 0) 00000100:00100000:3.0:1788869671.523807:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+6:11065:x1875765545172736:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 335us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869671.523819:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:3.0:1788869671.534938:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869671.535044:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545172864 00000100:00100000:2.0:1788869671.535058:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545172864 00000100:00100000:2.0:1788869671.535130:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:2.0:1788869671.535155:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff87299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+6:11067:x1875765545172864:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869671.535175:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869671.535196:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc2f0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa9f2 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535323:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f14 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535337:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535563:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535581:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2f1b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535589:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2f1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535596:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2f1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535653:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0e00/0xbead52e175fc2f22 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535661:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0e00/0xbead52e175fc2f22 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535668:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0e00/0xbead52e175fc2f22 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869671.535717:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788869671.535720:0:12967:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869671.535741:0:12967:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0e00/0xbead52e175fc2f22 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535751:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535758:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f14 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535764:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535770:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0c00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869671.535773:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535780:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f14 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535791:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff8b125500) 00010000:00010000:2.0:1788869671.535793:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869671.535798:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535804:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535816:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2f1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535832:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2f1b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535838:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2f1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535843:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869671.535846:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2f1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535852:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2f1b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535860:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99ffb89e0e00) 00010000:00010000:2.0:1788869671.535862:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869671.535865:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2f1b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535870:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2f1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535913:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc2f0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9f2 expref: 8 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535928:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0e00/0xbead52e175fc2f22 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9f2 expref: 7 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.535935:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99ffb89e0500) 00010000:00010000:2.0:1788869671.535938:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869671.535945:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0e00, rc 0) 00000100:00100000:2.0:1788869671.536013:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff87299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+7:11067:x1875765545172864:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 861us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869671.536021:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:1.0:1788869671.547137:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869671.547237:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545172992 00000100:00100000:0.0:1788869671.547247:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545172992 00000100:00100000:0.0:1788869671.547620:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:0.0:1788869671.547630:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bf4fff62-1855-4361-a244-1a23eb291d37+7:11067:x1875765545172992:12345-192.168.201.30@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788869671.547717:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bf4fff62-1855-4361-a244-1a23eb291d37+7:11067:x1875765545172992:12345-192.168.201.30@tcp:900:lhsmtool_posix.0 Request processed in 88us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869671.547725:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:1.0:1788869671.552247:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869671.552684:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545173248 00000100:00100000:2.0:1788869671.552701:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545173248 00000100:00100000:2.0:1788869671.552783:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:2.0:1788869671.552794:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+7:11067:x1875765545173248:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869671.552814:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869671.552833:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc2f29 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaa9f9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.552918:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2f30 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.552931:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2f30 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.552942:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2f30 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.554998:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f37 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.555019:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f37 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.555030:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f37 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.555156:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2f3e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.555181:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2f3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.555188:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2f3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869671.555199:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788869671.555322:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2f30 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.555330:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2f30 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.555337:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2f30 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.555720:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869671.555728:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2f30 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.555737:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2f30 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.555751:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99ffb89e0500) 00010000:00010000:2.0:1788869671.555754:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869671.555758:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2f30 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.555764:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2f30 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.555778:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f37 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.555792:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f37 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.555797:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f37 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.555801:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0c00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869671.555803:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f37 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.555809:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f37 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.555816:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99ffb89e0e00) 00010000:00010000:2.0:1788869671.555818:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869671.555821:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f37 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.555826:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f37 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.556116:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc2f29 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9f9 expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.556133:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2f3e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9f9 expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869671.556140:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffb89e0700) 00010000:00010000:2.0:1788869671.556143:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869671.556152:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1600, rc 0) 00000100:00100000:2.0:1788869671.556230:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+9:11067:x1875765545173248:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 3436us (3996us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788869671.556240:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:3.0:1788869671.558964:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869671.559060:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545173376 00000100:00100000:0.0:1788869671.559075:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545173376 00000100:00100000:0.0:1788869671.559607:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:0.0:1788869671.559620:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff87298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+9:11067:x1875765545173376:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788869671.559734:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff87298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+9:11067:x1875765545173376:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 Request processed in 117us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869671.559743:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:1.0:1788869671.561703:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869671.561999:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545173504 00000100:00100000:2.0:1788869671.562009:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545173504 00000100:00100000:2.0:1788869671.562119:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:2.0:1788869671.562130:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+5:11067:x1875765545173504:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1788869671.571419:0:12967:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 9234us 00000100:00080000:1.0:1788869671.572041:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869671.590296:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+5:11067:x1875765545173504:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 Request processed in 28158us (28591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869671.590311:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 44 00010000:00010000:0.0:1788869671.961603:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869672.153410:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788869672.154237:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788869672.557712:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869672.557756:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869672.557787:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869672.557804:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869672.557847:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869672.557880:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545173888 00000100:00100000:1.0:1788869672.557890:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545173888 00000100:00100000:1.0:1788869672.557945:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545174144 00000100:00100000:1.0:1788869672.557948:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545174144 00000100:00100000:1.0:1788869672.557972:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545173760 00000100:00100000:1.0:1788869672.557974:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545173760 00000100:00100000:1.0:1788869672.557984:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545174016 00000100:00100000:1.0:1788869672.557986:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545174016 00000100:00100000:1.0:1788869672.558003:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 279 00000100:00100000:1.0:1788869672.558012:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545173888:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869672.558096:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545173888:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 73us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869672.558117:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 279 00000100:00100000:1.0:1788869672.558133:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 280 00000100:00100000:1.0:1788869672.558139:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545174144:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869672.558165:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545174144:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869672.558171:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 280 00000100:00100000:1.0:1788869672.558182:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 281 00000100:00100000:1.0:1788869672.558188:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+9:2389:x1875765545173760:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869672.558225:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+9:2389:x1875765545173760:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 38us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869672.558230:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 281 00000100:00100000:1.0:1788869672.558241:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 282 00000100:00100000:1.0:1788869672.558246:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545174016:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869672.558301:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545174016:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 54us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869672.558307:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 282 00000100:00080000:1.0:1788869672.558328:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869672.558331:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869672.558997:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545173632 00000100:00100000:0.0:1788869672.559017:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545173632 00000100:00100000:0.0:1788869672.559374:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 378 00000100:00100000:0.0:1788869672.559386:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8a775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2389:x1875765545173632:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869672.559504:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8a775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2389:x1875765545173632:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 119us (1802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869672.559511:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 378 00000100:00100000:2.0:1788869672.856477:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554705664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869672.856547:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869672.856634:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554705664 00000100:00100000:3.0:1788869672.856642:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554705664 00000100:00100000:3.0:1788869672.856693:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788869672.856701:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554705664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869672.856727:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788869672.856844:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869672.859749:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554705664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3039us (3192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869672.859763:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788869672.859897:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869672.859921:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554705792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869672.859974:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869672.860016:0:13961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554705792 00000100:00100000:1.0:1788869672.860024:0:13961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554705792 00000100:00100000:1.0:1788869672.860080:0:13961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788869672.860088:0:13961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554705792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869672.860112:0:13961:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869672.860155:0:13961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554705792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869672.860162:0:13961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:1.0:1788869672.860178:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869672.860228:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554705792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869672.862678:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554705664:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788869672.984381:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869673.368784:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554705920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869673.368855:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869673.369402:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554705920 00000100:00100000:0.0:1788869673.369412:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554705920 00000100:00100000:0.0:1788869673.369468:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788869673.369479:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554705920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869673.369519:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788869673.369586:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554705920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869673.369593:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788869673.369722:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554705920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869673.867575:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869673.867952:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545174272 00000100:00100000:1.0:1788869673.867964:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545174272 00000100:00100000:1.0:1788869673.868041:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:1.0:1788869673.868053:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+9:11109:x1875765545174272:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1788869673.868075:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869673.868095:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8800/0xbead52e175fc2f4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaa00 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.868166:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc2f53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.868180:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc2f53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.868282:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc2f53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.868302:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc2f5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.868322:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc2f5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.868329:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc2f5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.868458:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc2f53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.868467:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc2f53 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.868473:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc2f53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.868479:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a8400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869673.868483:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc2f53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.868490:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc2f53 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.868501:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff8b125500) 00010000:00010000:1.0:1788869673.868504:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869673.868508:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc2f53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.868514:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc2f53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.868525:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc2f5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.868538:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc2f5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.868544:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc2f5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.868549:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a9000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869673.868552:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc2f5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.868559:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc2f5a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.868567:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99fe831e3d00) 00010000:00010000:1.0:1788869673.868570:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869673.868573:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc2f5a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.868579:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc2f5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788869673.869314:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788869673.869368:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8800/0xbead52e175fc2f4c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa00 expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.869458:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff8b125500) 00010000:00010000:1.0:1788869673.869461:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869673.869465:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8800/0xbead52e175fc2f4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa00 expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.869476:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a8800, rc 0) 00000100:00100000:1.0:1788869673.870560:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+9:11109:x1875765545174272:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 2505us (2986us total) trans 0 rc 301/301 00000100:00100000:1.0:1788869673.870570:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:1.0:1788869673.886904:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869673.887010:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545174528 00000100:00100000:1.0:1788869673.887022:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545174528 00000100:00100000:1.0:1788869673.887087:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:1.0:1788869673.887099:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+9:11109:x1875765545174528:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:1.0:1788869673.887174:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869673.888305:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc2f06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9eb expref: 9 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.888328:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff8b125500) 00010000:00010000:1.0:1788869673.888342:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869673.888506:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc2f61 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.888522:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc2f61 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.888531:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc2f61 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.888543:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc2f68 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.888550:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc2f68 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.888556:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc2f68 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.891212:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc2f6f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.891233:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc2f6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.891244:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc2f6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788869673.891280:0:6486:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007c739155 reply state 00000000ff60e3d8 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc2f6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.891292:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc2f6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.891298:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:1.0:1788869673.891301:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788869673.891304:0:6486:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788869673.891310:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788869673.891317:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc2f61 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.891323:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc2f61 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.891330:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc2f61 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.891335:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869673.891340:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc2f61 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.891360:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc2f61 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.891385:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fe831e3a00) 00010000:00010000:1.0:1788869673.891388:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869673.891401:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc2f61 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.891408:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc2f61 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788869673.891428:0:6486:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007c739155 reply state 00000000ff60e3d8 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc2f68 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.891436:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc2f68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869673.891442:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99fe831e3700) 00010000:00010000:1.0:1788869673.891445:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788869673.891446:0:6486:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788869673.891553:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+10:11109:x1875765545174528:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 4453us (4656us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788869673.891562:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:0.0:1788869673.990181:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869673.999124:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545174656 00000100:00100000:2.0:1788869673.999139:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545174656 00000100:00100000:3.0:1788869673.999415:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:3.0:1788869673.999427:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+10:11117:x1875765545174656:12345-192.168.201.30@tcp:101:lctl.0 00010000:00010000:3.0:1788869673.999454:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869673.999478:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2f76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaa07 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869673.999548:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc2f7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869673.999562:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc2f7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869673.999592:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc2f7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869673.999640:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788869673.999644:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869673.999681:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc2f7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869673.999709:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2f76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa07 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869673.999727:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc2f7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa07 expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869673.999735:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff88bbf300) 00010000:00010000:3.0:1788869673.999738:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869673.999741:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9e800, rc 0) 00000100:00100000:3.0:1788869673.999818:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+11:11117:x1875765545174656:12345-192.168.201.30@tcp:101:lctl.0 Request processed in 393us (9647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869673.999826:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 47 00010000:00010000:0.0:1788869674.008442:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869674.056751:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869674.056863:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545174784 00000100:00100000:2.0:1788869674.056875:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545174784 00000100:00100000:2.0:1788869674.056947:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:2.0:1788869674.056958:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+11:11123:x1875765545174784:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1788869674.056979:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869674.057000:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2f84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaa0e expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.057073:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.057104:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.057115:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.057127:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc2f92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.057134:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc2f92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.057141:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc2f92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.057233:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2f99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.057241:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2f99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.057248:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2f99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869674.057618:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788869674.057623:0:12967:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869674.057664:0:12967:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2f99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.057678:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.057684:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f8b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.057697:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.057703:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0c00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869674.057707:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.057715:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f8b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.057727:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff88bbf300) 00010000:00010000:3.0:1788869674.057730:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869674.057735:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.057741:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc2f8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.057756:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc2f92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.057761:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc2f92 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.057766:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc2f92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.057770:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1e00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869674.057773:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc2f92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.057786:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc2f92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.057794:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99fe831e3700) 00010000:00010000:3.0:1788869674.057796:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869674.057798:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc2f92 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.057804:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc2f92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.057828:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc2f84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa0e expref: 13 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.057840:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2f99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa0e expref: 12 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.057847:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:3.0:1788869674.057849:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788869674.057852:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1000, rc 0) 00000100:00100000:3.0:1788869674.057915:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+12:11123:x1875765545174784:12345-192.168.201.30@tcp:101:bash.0 Request processed in 959us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869674.057922:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:0.0:1788869674.062358:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869674.062559:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545175040 00000100:00100000:1.0:1788869674.062569:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545175040 00000100:00100000:1.0:1788869674.062631:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:1.0:1788869674.062640:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+12:11123:x1875765545175040:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:1.0:1788869674.062661:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869674.062696:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc2fa0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaa15 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.062807:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc2fa7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.062822:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc2fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.062833:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc2fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.062849:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc2fae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.062856:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc2fae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.062862:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc2fae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788869674.063185:0:9496:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788869674.063364:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc2fb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.063373:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc2fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.063380:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc2fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.063426:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc2fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.063444:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc2fa7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.063451:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc2fa7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.063457:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80030a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869674.063462:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc2fa7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.063469:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc2fa7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.063483:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:1.0:1788869674.063486:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869674.063490:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc2fa7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.063497:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc2fa7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788869674.063512:0:9496:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000338ebbac reply state 00000000a9c59028 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc2fae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.063523:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc2fae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.063529:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99fe831e3a00) 00010000:00010000:1.0:1788869674.063532:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788869674.063535:0:9496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788869674.063567:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc2fa0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa15 expref: 15 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.063591:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc2fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa15 expref: 14 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.063598:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe831e3d00) 00010000:00010000:1.0:1788869674.063600:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869674.063603:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80031400, rc 0) 00000100:00100000:1.0:1788869674.063671:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+15:11123:x1875765545175040:12345-192.168.201.30@tcp:101:bash.0 Request processed in 1031us (1322us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788869674.063679:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:0.0:1788869674.068151:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869674.068356:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545175168 00000100:00100000:3.0:1788869674.068367:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545175168 00000100:00100000:3.0:1788869674.068471:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:3.0:1788869674.068479:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2386:x1875765545175168:12345-192.168.201.30@tcp:8:bash.0 00010000:00080000:3.0:1788869674.068515:0:8400:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp t0 exp 0000000000000000 cur 291 last 0 00000020:00000080:3.0:1788869674.068562:0:8400:0:(genops.c:1406:class_connect()) connect: client bf4fff62-1855-4361-a244-1a23eb291d37, cookie 0xbead52e175fc2fc3 00002000:00100000:3.0:1788869674.068574:0:8400:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bf4fff62-1855-4361-a244-1a23eb291d37/ffff99fe8385d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788869674.068590:0:8400:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788869674.068663:0:8400:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788869674.068691:0:8400:0:(import.c:65:import_set_state_nolock()) ffff99fe8385f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869674.068761:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2386:x1875765545175168:12345-192.168.201.30@tcp:8:bash.0 Request processed in 280us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869674.068769:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:1.0:1788869674.071175:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869674.071454:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545175296 00000100:00100000:3.0:1788869674.071463:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545175296 00000100:00100000:3.0:1788869674.071576:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:3.0:1788869674.071587:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:0:x1875765545175296:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1788869674.071604:0:8399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869674.071630:0:8399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000690c56ed/0xbead52e175fc2fca lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaa1c expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869674.071656:0:8399:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869674.071675:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=291s v=(0 0) 00010000:00010000:3.0:1788869674.071680:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869674.071689:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000690c56ed/0xbead52e175fc2fca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa1c expref: 7 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.071709:0:8399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000690c56ed/0xbead52e175fc2fca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa1c expref: 7 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.071722:0:8399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9fc00, rc 0) 00000100:00100000:3.0:1788869674.071845:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+7:0:x1875765545175296:12345-192.168.201.30@tcp:101:bash.0 Request processed in 259us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869674.071852:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00080000:0.0:1788869674.071921:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869674.078999:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869674.079080:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545175424 00000100:00100000:2.0:1788869674.079089:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545175424 00000100:00100000:2.0:1788869674.079147:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:2.0:1788869674.079157:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf4fff62-1855-4361-a244-1a23eb291d37+7:11123:x1875765545175424:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1788869674.079174:0:8527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869674.079203:0:8527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc2fd1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaa23 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.079246:0:8527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000690c56ed/0xbead52e175fc2fca lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa1c expref: 8 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.079272:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788869674.079277:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869674.079282:0:8527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc2fd1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa23 expref: 8 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.079318:0:8527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000690c56ed/0xbead52e175fc2fca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa1c expref: 8 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.079331:0:8527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000690c56ed/0xbead52e175fc2fca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa1c expref: 8 pid: 8399 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869674.079346:0:8527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8527:1875765554706048:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788869674.079568:0:8527:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff85566240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869674.083007:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869674.083249:0:8527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8527:1875765554706048:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788869674.083314:0:8527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc2fd1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa23 expref: 8 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.083334:0:8527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1200, rc 0) 00000100:00100000:0.0:1788869674.084030:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf4fff62-1855-4361-a244-1a23eb291d37+8:11123:x1875765545175424:12345-192.168.201.30@tcp:101:bash.0 Request processed in 4872us (5038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869674.084053:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:3.0:1788869674.085847:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545175552 00000100:00100000:3.0:1788869674.085859:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545175552 00010000:00010000:3.0:1788869674.086004:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000690c56ed/0xbead52e175fc2fca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa1c expref: 8 pid: 8399 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869674.086105:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:3.0:1788869674.086116:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89dab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+8:2387:x1875765545175552:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869674.086131:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869674.086153:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000690c56ed/0xbead52e175fc2fca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa1c expref: 8 pid: 8399 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.086166:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000690c56ed/0xbead52e175fc2fca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa1c expref: 8 pid: 8399 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.086207:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000690c56ed/0xbead52e175fc2fca lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa1c expref: 8 pid: 8399 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.086225:0:6471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869674.086229:0:6471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869674.086238:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc2fd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa23 expref: 7 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.086247:0:6471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc2fd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa23 expref: 7 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.086339:0:6471:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc2fd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa23 expref: 7 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869674.086354:0:6471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff8729a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6471:1875765554706176:192.168.201.30@tcp:105: 00000100:00100000:3.0:1788869674.086772:0:6471:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8831bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869674.094500:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869674.094619:0:6471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff8729a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6471:1875765554706176:192.168.201.30@tcp:105: 00010000:00010000:3.0:1788869674.094642:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869674.094692:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89dab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+7:2387:x1875765545175552:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 8577us (11694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869674.094704:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:0.0:1788869674.096984:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545175808 00000100:00100000:0.0:1788869674.096996:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545175808 00000100:00100000:1.0:1788869674.099555:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:1.0:1788869674.099571:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+15:11123:x1875765545175808:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:1.0:1788869674.101947:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+16:11123:x1875765545175808:12345-192.168.201.30@tcp:35:bash.0 Request processed in 322us (5397us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788869674.101962:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:1.0:1788869674.219490:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869674.219711:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545176064 00000100:00100000:3.0:1788869674.219723:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545176064 00000100:00100000:3.0:1788869674.219790:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:3.0:1788869674.219800:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+16:11133:x1875765545176064:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869674.219824:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869674.219846:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2fd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaa2a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869674.220160:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788869674.220598:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2fd8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa2a expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.220687:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff88bbf300) 00010000:00010000:3.0:1788869674.220691:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869674.220711:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2fd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa2a expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.220726:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9fc00, rc 0) 00000100:00100000:3.0:1788869674.220795:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+17:11133:x1875765545176064:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 996us (1315us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1788869674.220803:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:0.0:1788869674.227205:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869674.227357:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545176320 00000100:00100000:2.0:1788869674.227368:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545176320 00000100:00100000:2.0:1788869674.227437:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:2.0:1788869674.227447:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+17:11133:x1875765545176320:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1788869674.228441:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+18:11133:x1875765545176320:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 993us (1254us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788869674.228466:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:0.0:1788869674.473358:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869674.473467:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545176448 00000100:00100000:1.0:1788869674.473476:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545176448 00000100:00100000:1.0:1788869674.473541:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:1.0:1788869674.473551:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+18:11139:x1875765545176448:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1788869674.473576:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869674.473598:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc2fe6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaa31 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.473699:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc2fed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.473714:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc2fed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.473728:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc2fed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869674.473769:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788869674.473773:0:6486:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869674.473793:0:6486:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc2fed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.473819:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc2fe6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa31 expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.473839:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc2fed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa31 expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.473848:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:1.0:1788869674.473850:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869674.473854:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80030a00, rc 0) 00000100:00100000:1.0:1788869674.474135:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+19:11139:x1875765545176448:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 584us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869674.474142:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:2.0:1788869674.492642:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869674.492806:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545176704 00000100:00100000:3.0:1788869674.492817:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545176704 00000100:00100000:3.0:1788869674.492897:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:3.0:1788869674.492909:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+19:11139:x1875765545176704:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869674.492937:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869674.492960:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2ff4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaa38 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.493081:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc2ffb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.493095:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc2ffb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.493107:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc2ffb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869674.493120:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788869674.493851:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc2ff4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa38 expref: 22 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.493873:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc2ffb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa38 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.494020:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe831e3d00) 00010000:00010000:3.0:1788869674.494023:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869674.494027:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9ee00, rc 0) 00000100:00100000:3.0:1788869674.494086:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+21:11139:x1875765545176704:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1178us (1453us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788869674.494093:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:2.0:1788869674.503705:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869674.509156:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545176960 00000100:00100000:3.0:1788869674.509172:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545176960 00000100:00100000:3.0:1788869674.509701:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:3.0:1788869674.509712:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+21:11139:x1875765545176960:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869674.509739:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869674.509761:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3009 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaa3f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.509865:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3010 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.509879:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3010 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.509901:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3010 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869674.509914:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788869674.510058:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3009 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa3f expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.510099:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3010 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa3f expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.510108:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe831e3d00) 00010000:00010000:1.0:1788869674.510111:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788869674.510114:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9f600, rc 0) 00000100:00100000:0.0:1788869674.520492:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869674.522439:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+23:11139:x1875765545176960:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 12719us (18734us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788869674.522452:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:3.0:1788869674.534880:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545177088 00000100:00100000:3.0:1788869674.534976:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545177088 00000100:00100000:3.0:1788869674.535138:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:3.0:1788869674.535151:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+23:2390:x1875765545177088:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869674.535184:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869674.535219:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc2ffb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa38 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.535239:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe831e3d00) 00010000:00010000:3.0:1788869674.535244:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869674.535344:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+22:2390:x1875765545177088:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 196us (14862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869674.535352:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:2.0:1788869674.539505:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869674.539588:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545177216 00000100:00100000:3.0:1788869674.539598:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545177216 00000100:00100000:3.0:1788869674.539657:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:3.0:1788869674.539667:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+7:2390:x1875765545177216:12345-192.168.201.30@tcp:1:lfs.0 00010000:00010000:3.0:1788869674.539711:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc301e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.539730:0:8399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc2fd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa23 expref: 7 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.539738:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869674.539742:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788869674.539746:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc301e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.539780:0:8399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc2fd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa23 expref: 7 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.539812:0:8399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc2fd1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa23 expref: 7 pid: 8527 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869674.539827:0:8399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff8729a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8399:1875765554706304:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869674.539933:0:8399:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84fade40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869674.548795:0:8399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff8729a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8399:1875765554706304:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869674.548827:0:8399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc301e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869674.549183:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869674.549715:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545177344 00000100:00100000:3.0:1788869674.549724:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545177344 00002000:00100000:3.0:1788869674.549770:0:8404:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff99ff88011500 x1875765545177344/t0(0) o4->bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp:620/0 lens 504/0 e 0 to 0 dl 1788869685 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788869674.549780:0:8404:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ff88011500 with x1875765545177344 ext(0->12) 00010000:00010000:3.0:1788869674.549788:0:8404:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc2fd1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa23 expref: 8 pid: 8527 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.549801:0:8404:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc2fd1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa23 expref: 8 pid: 8527 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869674.549808:0:8404:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99ff88011500 00000100:00100000:3.0:1788869674.549844:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:3.0:1788869674.549852:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf4fff62-1855-4361-a244-1a23eb291d37+8:2387:x1875765545177344:12345-192.168.201.30@tcp:4:lfs.0 00000001:00100000:1.0:1788869674.553844:0:9476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bf4fff62-1855-4361-a244-1a23eb291d37 00000100:00100000:3.0:1788869674.557364:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf4fff62-1855-4361-a244-1a23eb291d37+9:2387:x1875765545177344:12345-192.168.201.30@tcp:4:lfs.0 Request processed in 7500us (8169us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788869674.557379:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00002000:00100000:3.0:1788869674.557391:0:8404:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff99ff88011500 x1875765545177344/t4294967300(0) o4->bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp:620/0 lens 504/448 e 0 to 0 dl 1788869685 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788869674.557411:0:8404:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ff88011500 with x1875765545177344 ext(0->12) 00010000:00010000:3.0:1788869674.557422:0:8404:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc2fd1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa23 expref: 9 pid: 8527 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.557442:0:8404:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc2fd1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa23 expref: 9 pid: 8527 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869674.557449:0:8404:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99ff88011500 00000100:00100000:2.0:1788869674.561591:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869674.565796:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545177472 00000100:00100000:0.0:1788869674.565811:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545177472 00010000:00010000:0.0:1788869674.565862:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc2fd1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa23 expref: 9 pid: 8527 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869674.566521:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:0.0:1788869674.566535:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+9:2389:x1875765545177472:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869674.566554:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788869674.566574:0:6470:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788869674.566577:0:6470:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788869674 00002000:00010000:0.0:1788869674.566580:0:6470:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788869675 00002000:00010000:0.0:1788869674.566582:0:6470:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788869674 00002000:00010000:0.0:1788869674.566584:0:6470:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788869674.566591:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc2fd1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa23 expref: 9 pid: 8527 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.566606:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc2fd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa23 expref: 9 pid: 8527 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.566632:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc2fd1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa23 expref: 9 pid: 8527 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.566662:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869674.566667:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869674.566672:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc301e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.566682:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc301e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.566721:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869674.566780:0:8399:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc301e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.566790:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc301e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869674.566790:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+8:2389:x1875765545177472:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 259us (5208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869674.566798:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 53 00010000:00010000:2.0:1788869674.566810:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc301e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.566818:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc301e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.566826:0:8399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc301e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.566833:0:8399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fe00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869674.566837:0:8399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc301e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.566846:0:8399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc301e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.566871:0:8399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc301e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.566878:0:8399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc301e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869674.566930:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+7:2390:x1875765545177216:12345-192.168.201.30@tcp:1:lfs.0 Request processed in 27265us (27557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869674.566938:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:3.0:1788869674.577866:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869674.578556:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545177728 00000100:00100000:2.0:1788869674.578567:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545177728 00000100:00100000:2.0:1788869674.578639:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:2.0:1788869674.578650:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8729a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+22:11139:x1875765545177728:12345-192.168.201.30@tcp:35:lfs.0 00000004:00010000:2.0:1788869674.578720:0:6488:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3010 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa3f expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788869674.578952:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1788869674.578995:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788869674.579315:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1788869674.579366:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3025 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.579381:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc2fb5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa15 expref: 26 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.579391:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3025 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.579454:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc2fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa15 expref: 26 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869674.579468:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc2fb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa15 expref: 26 pid: 9496 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869674.579483:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb2f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6488:1875765554706432:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788869674.579572:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff85566600 going to sleep for 11 seconds 00000100:00100000:1.0:1788869674.582566:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb2f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6488:1875765554706432:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788869674.582599:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3025 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869674.583956:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869674.584035:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545177856 00000100:00100000:0.0:1788869674.584044:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545177856 00010000:00010000:0.0:1788869674.584079:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc2fb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa15 expref: 27 pid: 9496 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869674.584119:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:0.0:1788869674.584128:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff87298a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+27:2387:x1875765545177856:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869674.584143:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869674.584149:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc2fb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa15 expref: 27 pid: 9496 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.584161:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc2fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa15 expref: 27 pid: 9496 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.584205:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc2fb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa15 expref: 27 pid: 9496 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.584222:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe831e3d00) 00010000:00010000:0.0:1788869674.584228:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3025 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.584237:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3025 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.584246:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3025 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.584304:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869674.584350:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff87298a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+26:2387:x1875765545177856:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 223us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869674.584357:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 54 00010000:00010000:3.0:1788869674.585335:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3025 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.585346:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3025 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788869674.585479:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1788869674.585590:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1788869674.585700:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff8729aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6488:1875765554706560:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788869674.585760:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869674.585793:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84fad780 going to sleep for 11 seconds 00000100:00100000:0.0:1788869674.590126:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554706560 00000100:00100000:0.0:1788869674.590144:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554706560 00000100:00100000:0.0:1788869674.590239:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788869674.590270:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff87298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6488:x1875765554706560:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788869674.590426:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff87298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6488:x1875765554706560:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 178us (4665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869674.590434:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788869674.590619:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff8729aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6488:1875765554706560:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788869674.590831:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1788869674.590909:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff8729aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6488:1875765554706688:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788869674.590963:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869674.590997:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8bdb000 going to sleep for 11 seconds 00000100:00100000:2.0:1788869674.591046:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554706688 00000100:00100000:2.0:1788869674.591052:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554706688 00000100:00100000:2.0:1788869674.591088:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788869674.591096:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff87298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6488:x1875765554706688:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788869674.591215:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff87298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6488:x1875765554706688:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 120us (252us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788869674.591222:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1788869674.591547:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869674.594099:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff8729aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6488:1875765554706688:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788869674.594186:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1788869674.594249:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3025 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.594287:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3025 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.594296:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3025 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.594302:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869674.594307:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3025 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.594314:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3025 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.594330:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe831e3d00) 00010000:00010000:3.0:1788869674.594333:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788869674.594338:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3025 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.594345:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3025 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788869674.594471:0:6488:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788869674.594545:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788869674.594557:0:6488:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 292521303606ns, next at 293521300673ns, rc = 0 00000001:00080000:3.0:1788869674.594563:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1788869674.594587:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe831e3d00) 00010000:00010000:3.0:1788869674.594590:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788869674.594596:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3010 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa3f expref: 30 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869674.594708:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8729a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+29:11139:x1875765545177728:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 16060us (16852us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1788869674.594717:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00000020:00080000:3.0:1788869674.594722:0:6488:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788869674.602321:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869674.602424:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545177984 00000100:00100000:0.0:1788869674.602434:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545177984 00000100:00100000:0.0:1788869674.602503:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:0.0:1788869674.602514:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8729b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+29:11139:x1875765545177984:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1788869674.602552:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869674.602579:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2200/0xbead52e175fc302c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaa46 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.602641:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2200/0xbead52e175fc302c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa46 expref: 30 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.602657:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2200/0xbead52e175fc302c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa46 expref: 30 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.602674:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:0.0:1788869674.602677:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869674.602681:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb98e2200, rc 0) 00000100:00100000:0.0:1788869674.602741:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8729b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+30:11139:x1875765545177984:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 228us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869674.602748:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:1.0:1788869674.609516:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869674.609660:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545178240 00000100:00100000:3.0:1788869674.609669:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545178240 00000100:00100000:3.0:1788869674.609734:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:3.0:1788869674.609745:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+30:11139:x1875765545178240:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1788869674.609997:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+31:11139:x1875765545178240:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 253us (490us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788869674.610005:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:2.0:1788869674.810249:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869674.810422:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545178496 00000100:00100000:3.0:1788869674.810432:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545178496 00000100:00100000:3.0:1788869674.810495:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:3.0:1788869674.810506:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+31:11149:x1875765545178496:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869674.810530:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869674.810552:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3033 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaa4d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869674.810679:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788869674.810781:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3033 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa4d expref: 33 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.810796:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff88bbf300) 00010000:00010000:3.0:1788869674.810800:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869674.810806:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3033 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa4d expref: 33 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869674.810820:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9f600, rc 0) 00000100:00100000:3.0:1788869674.810892:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+32:11149:x1875765545178496:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 387us (654us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1788869674.810900:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:2.0:1788869674.818751:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869674.818850:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545178624 00000100:00100000:0.0:1788869674.818860:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545178624 00000100:00100000:0.0:1788869674.818946:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:0.0:1788869674.818957:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+32:11149:x1875765545178624:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:0.0:1788869674.819043:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3a00/0xbead52e175fc3041 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819060:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3a00/0xbead52e175fc3041 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819073:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3a00/0xbead52e175fc3041 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819102:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc3048 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819109:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc3048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819116:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc3048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819421:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc304f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819431:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc304f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819437:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc304f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869674.819487:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc304f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819500:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3a00/0xbead52e175fc3041 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819506:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3a00/0xbead52e175fc3041 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819513:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3a00/0xbead52e175fc3041 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819519:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb98e3a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869674.819523:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3a00/0xbead52e175fc3041 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819538:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3a00/0xbead52e175fc3041 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819551:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:0.0:1788869674.819554:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869674.819559:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3a00/0xbead52e175fc3041 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819565:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3a00/0xbead52e175fc3041 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819578:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc3048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819584:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc3048 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819589:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc3048 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819595:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb98e3000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869674.819598:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc3048 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819603:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc3048 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819609:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99fe831e3a00) 00010000:00010000:0.0:1788869674.819612:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869674.819615:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc3048 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819631:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc3048 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819641:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc304f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819646:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc304f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819652:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc304f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819656:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb98e3400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869674.819659:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc304f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819665:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc304f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819673:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:0.0:1788869674.819675:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869674.819678:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc304f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869674.819683:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc304f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869674.819760:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+32:11149:x1875765545178624:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 804us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869674.819767:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:2.0:1788869674.824328:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869674.824632:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545178880 00000100:00100000:3.0:1788869674.824642:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545178880 00000100:00100000:3.0:1788869674.824698:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:3.0:1788869674.824708:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+32:11149:x1875765545178880:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1788869674.825527:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+33:11149:x1875765545178880:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 816us (1203us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788869674.825536:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:2.0:1788869674.898702:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869674.898856:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545179136 00000100:00100000:1.0:1788869674.898866:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545179136 00000100:00100000:1.0:1788869674.899745:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:1.0:1788869674.899760:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+33:11152:x1875765545179136:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1788869674.899785:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869674.899806:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3056 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaa54 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.899899:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc305d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.899913:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc305d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.899942:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc305d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.899957:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3064 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.899964:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3064 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.899970:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3064 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.900075:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc306b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.900084:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc306b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.900092:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc306b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869674.900102:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788869674.900180:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc305d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.900197:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc305d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.900204:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc305d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.900210:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869674.900214:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc305d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.900220:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc305d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.900231:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:1.0:1788869674.900233:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869674.900237:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc305d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.900242:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc305d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.900666:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3064 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.900674:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3064 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.900679:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3064 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.900684:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80030000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869674.900693:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3064 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.900699:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3064 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.900709:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99fe831e3a00) 00010000:00010000:1.0:1788869674.900712:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869674.900715:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3064 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.900722:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3064 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.900769:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3056 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa54 expref: 36 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.900784:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc306b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa54 expref: 35 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.900791:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:1.0:1788869674.900794:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869674.900796:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80031400, rc 0) 00000100:00100000:1.0:1788869674.900872:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+35:11152:x1875765545179136:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1117us (2180us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788869674.900879:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:2.0:1788869674.907611:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869674.907692:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545179264 00000100:00100000:1.0:1788869674.907703:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545179264 00000100:00100000:1.0:1788869674.907779:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:1.0:1788869674.907791:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+35:11152:x1875765545179264:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:1.0:1788869674.907899:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8800/0xbead52e175fc3079 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.907921:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8800/0xbead52e175fc3079 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.907944:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8800/0xbead52e175fc3079 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.907995:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8800/0xbead52e175fc3079 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.908003:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8800/0xbead52e175fc3079 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.908010:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8800/0xbead52e175fc3079 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.908017:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a8800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869674.908022:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8800/0xbead52e175fc3079 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.908030:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8800/0xbead52e175fc3079 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.908042:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:1.0:1788869674.908045:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869674.908050:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8800/0xbead52e175fc3079 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869674.908057:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8800/0xbead52e175fc3079 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869674.908167:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+35:11152:x1875765545179264:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 377us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869674.908175:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:2.0:1788869674.911983:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869674.912081:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545179520 00000100:00100000:0.0:1788869674.912092:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545179520 00000100:00100000:0.0:1788869674.912152:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1788869674.912161:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+35:11152:x1875765545179520:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1788869674.912746:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+36:11152:x1875765545179520:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 583us (768us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788869674.912755:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00010000:00010000:0.0:1788869675.032537:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869675.344329:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869675.344382:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545179776 00000100:00100000:0.0:1788869675.344393:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545179776 00000100:00100000:0.0:1788869675.344542:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:0.0:1788869675.344554:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+36:11183:x1875765545179776:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:0.0:1788869675.344579:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869675.344600:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc3080 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaa5b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869675.344719:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc3087 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869675.344734:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc3087 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869675.344746:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc3087 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869675.344758:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788869675.344883:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc3080 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa5b expref: 39 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869675.344918:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc3087 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa5b expref: 38 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869675.344943:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:0.0:1788869675.344946:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869675.344950:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb98e3000, rc 0) 00000100:00100000:0.0:1788869675.345013:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+38:11183:x1875765545179776:12345-192.168.201.30@tcp:101:cat.0 Request processed in 461us (691us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788869675.345020:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00080000:1.0:1788869675.345707:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869675.357100:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869675.357147:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869675.358387:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545180160 00000100:00100000:0.0:1788869675.358406:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545180160 00000100:00100000:0.0:1788869675.358476:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:0.0:1788869675.358487:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+38:2387:x1875765545180160:12345-192.168.201.30@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788869675.358530:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545180032 00000100:00100000:3.0:1788869675.358536:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545180032 00000100:00100000:3.0:1788869675.358582:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:3.0:1788869675.358590:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+39:11183:x1875765545180032:12345-192.168.201.30@tcp:35:cat.0 00010000:00010000:0.0:1788869675.358618:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869675.358642:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc3087 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa5b expref: 39 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869675.358659:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:0.0:1788869675.358663:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869675.358715:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+38:2387:x1875765545180160:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 231us (1567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869675.358722:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:3.0:1788869675.358825:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+38:11183:x1875765545180032:12345-192.168.201.30@tcp:35:cat.0 Request processed in 234us (1734us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1788869675.358846:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1788869675.416673:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869675.416699:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554706816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869675.416790:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869675.416917:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554706816 00000100:00100000:2.0:1788869675.416935:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554706816 00000100:00100000:2.0:1788869675.416998:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788869675.417008:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1875765554706816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869675.417037:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788869675.417083:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1875765554706816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869675.417089:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788869675.417387:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff8729a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554706944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869675.417427:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869675.417481:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554706816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869675.417606:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554706944 00000100:00100000:3.0:1788869675.417611:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554706944 00000100:00100000:3.0:1788869675.417645:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788869675.417652:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554706944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869675.417679:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1788869675.417731:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554706944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869675.417738:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788869675.417809:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff8729a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554706944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869675.443090:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869675.443188:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545180416 00000100:00100000:1.0:1788869675.443203:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545180416 00000100:00100000:3.0:1788869675.443287:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:3.0:1788869675.443300:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+38:11189:x1875765545180416:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:3.0:1788869675.443326:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869675.443330:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788869675.443356:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc2fed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa31 expref: 38 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869675.443452:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:3.0:1788869675.443459:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869675.443475:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3095 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaa62 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869675.443592:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc309c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869675.443607:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc306b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa54 expref: 38 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869675.443634:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc309c lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869675.443668:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc306b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa54 expref: 38 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869675.443682:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc306b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa54 expref: 38 pid: 12967 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869675.443696:0:6486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff8729a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6486:1875765554707072:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869675.443861:0:6486:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8bdb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869675.446969:0:6486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff8729a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6486:1875765554707072:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869675.446999:0:6486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc309c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869675.449300:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869675.450079:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545180544 00000100:00100000:0.0:1788869675.450090:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545180544 00010000:00010000:0.0:1788869675.450136:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc306b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa54 expref: 39 pid: 12967 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869675.450182:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:0.0:1788869675.450210:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+39:2387:x1875765545180544:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869675.450225:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869675.450231:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc306b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa54 expref: 39 pid: 12967 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869675.450244:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc306b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa54 expref: 39 pid: 12967 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869675.450297:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc306b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa54 expref: 39 pid: 12967 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869675.450315:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:0.0:1788869675.450321:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc309c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869675.450330:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc309c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869675.450533:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc309c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869675.450572:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869675.450628:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+38:2387:x1875765545180544:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 420us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869675.450635:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 55 00010000:00010000:1.0:1788869675.450708:0:6486:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc309c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869675.450716:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc309c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869675.450736:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788869675.450880:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3095 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa62 expref: 39 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869675.450895:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc309c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa62 expref: 38 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869675.450903:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:1.0:1788869675.450918:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788869675.450921:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9fc00, rc 0) 00000100:00100000:1.0:1788869675.450948:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+38:11189:x1875765545180416:12345-192.168.201.30@tcp:101:dd.0 Request processed in 7652us (7868us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1788869675.450955:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:2.0:1788869675.458578:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869675.462537:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545180672 00000100:00100000:0.0:1788869675.462551:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545180672 00000100:00100000:0.0:1788869675.462676:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:0.0:1788869675.462686:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+38:11189:x1875765545180672:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1788869675.462713:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869675.462737:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc30aa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaa69 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869675.462769:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc30b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869675.462780:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc30b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869675.462789:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc30b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869675.462896:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc30aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa69 expref: 40 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869675.462923:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc30b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa69 expref: 39 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869675.462937:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:0.0:1788869675.462940:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788869675.462944:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb98e3400, rc 0) 00000100:00100000:0.0:1788869675.463018:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+39:11189:x1875765545180672:12345-192.168.201.30@tcp:101:dd.0 Request processed in 332us (4450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869675.463026:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:3.0:1788869675.472249:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869675.472800:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545180928 00000100:00100000:0.0:1788869675.472811:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545180928 00000100:00100000:0.0:1788869675.472873:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:0.0:1788869675.472883:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8729a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+39:11189:x1875765545180928:12345-192.168.201.30@tcp:36:dd.0 00010000:00010000:0.0:1788869675.473126:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3a00/0xbead52e175fc30b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869675.473144:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3a00/0xbead52e175fc30b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869675.473156:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3a00/0xbead52e175fc30b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869675.473201:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1788869675.473225:0:6485:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000075321db4 reply state 00000000de59a76a transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3a00/0xbead52e175fc30b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869675.473238:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3a00/0xbead52e175fc30b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869675.473246:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:0.0:1788869675.473249:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869675.473310:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869675.473532:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8729a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+42:11189:x1875765545180928:12345-192.168.201.30@tcp:36:dd.0 Request processed in 650us (1292us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1788869675.473541:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 62 00000020:00080000:0.0:1788869675.473546:0:6485:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788869675.923408:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869675.923569:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545181056 00000100:00100000:3.0:1788869675.923580:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545181056 00000100:00100000:3.0:1788869675.923656:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:3.0:1788869675.923667:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+42:11203:x1875765545181056:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:3.0:1788869675.923692:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869675.923714:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc30bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaa70 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869675.923795:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc30c6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869675.923827:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc30c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869675.923840:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc30c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869675.923854:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc30cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869675.923862:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc30cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869675.923869:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc30cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869675.923947:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc30d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869675.923958:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc309c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa62 expref: 43 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869675.923967:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc30d4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869675.924000:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc309c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa62 expref: 43 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869675.924013:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc309c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa62 expref: 43 pid: 6486 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869675.924037:0:6486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff8729b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6486:1875765554707200:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869675.924133:0:6486:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8bdb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869675.932838:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869675.932871:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554707328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869675.932972:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869675.933728:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869675.933754:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545181312 00000100:00100000:1.0:1788869675.933764:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545181312 00000100:00100000:1.0:1788869675.933819:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:1.0:1788869675.933829:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+44:6153:x1875765545181312:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788869675.934123:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+45:6153:x1875765545181312:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 294us (397us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788869675.934130:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:0.0:1788869675.934678:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554707328 00000100:00100000:0.0:1788869675.934685:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554707328 00000100:00100000:0.0:1788869675.934738:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788869675.934747:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554707328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869675.934765:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788869675.934816:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554707328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (1844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869675.934823:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788869675.934873:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554707328:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788869675.935710:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869675.935851:0:6486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff8729b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6486:1875765554707200:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869675.935873:0:6486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc30d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869675.936468:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554707456:0@lo:400:kworker.0 00000100:00100000:0.0:1788869675.936520:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869675.936598:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554707456 00000100:00100000:3.0:1788869675.936604:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554707456 00000100:00100000:3.0:1788869675.936649:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1788869675.936658:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff994d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554707456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869675.938465:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554707584:0@lo:400:kworker.0 00000100:00100000:1.0:1788869675.938526:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869675.938567:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869675.938574:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554707712:0@lo:400:kworker.0 00000100:00100000:1.0:1788869675.938596:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869675.938625:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554707840:0@lo:400:kworker.0 00000100:00100000:1.0:1788869675.938653:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869675.938686:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554707840 00000100:00100000:1.0:1788869675.938692:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554707840 00000100:00100000:1.0:1788869675.938736:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788869675.938743:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554707840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869675.938794:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554707840:12345-0@lo:400:kworker.0 Request processed in 50us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869675.938800:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788869675.938840:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554707840:0@lo:400:kworker.0 00000100:00100000:1.0:1788869675.938887:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554707584 00000100:00100000:1.0:1788869675.938890:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554707584 00000100:00100000:1.0:1788869675.938916:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554707712 00000100:00100000:1.0:1788869675.938919:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554707712 00000100:00100000:1.0:1788869675.938938:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788869675.938944:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554707584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869675.938982:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554707584:12345-0@lo:400:kworker.0 Request processed in 39us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869675.938988:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788869675.939002:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788869675.939008:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554707712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869675.939049:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554707712:12345-0@lo:400:kworker.0 Request processed in 42us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869675.939054:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788869675.939080:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554707712:0@lo:400:kworker.0 00000100:00100000:1.0:1788869675.939090:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554707584:0@lo:400:kworker.0 00000100:00100000:3.0:1788869675.939745:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff994d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554707456:12345-0@lo:400:kworker.0 Request processed in 3086us (3222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869675.939754:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788869675.940175:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554707456:0@lo:400:kworker.0 00000100:00100000:2.0:1788869675.940380:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869675.940392:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554708096:0@lo:400:kworker.0 00000100:00100000:2.0:1788869675.940441:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869675.940471:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554708096 00000100:00100000:2.0:1788869675.940476:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554708096 00000100:00100000:2.0:1788869675.940516:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788869675.940524:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875765554708096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869675.940562:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875765554708096:12345-0@lo:400:kworker.0 Request processed in 40us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869675.940567:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00080000:2.0:1788869675.940583:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788869675.940602:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfb2c000 x1875765554708096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869675.940612:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554708096:0@lo:400:kworker.0 00000100:00100000:2.0:1788869675.940643:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554708224:0@lo:400:kworker.0 00000100:00100000:2.0:1788869675.940668:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869675.940740:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869675.940754:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554708608:0@lo:400:kworker.0 00000100:00100000:2.0:1788869675.940779:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869675.940833:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554708608 00000100:00100000:2.0:1788869675.940837:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554708608 00000100:00100000:2.0:1788869675.940864:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788869675.940870:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875765554708608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869675.940907:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875765554708608:12345-0@lo:400:kworker.0 Request processed in 36us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869675.940913:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:2.0:1788869675.940927:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788869675.940941:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfb10000 x1875765554708608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869675.940951:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554708608:0@lo:400:kworker.0 00000100:00100000:0.0:1788869675.941030:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875765554707968:0@lo:400:kworker.0 00000100:00100000:0.0:1788869675.941061:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869675.941084:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1875765554708480:0@lo:400:kworker.0 00000100:00100000:0.0:1788869675.941105:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869675.941121:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869675.941127:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554708352:0@lo:400:kworker.0 00000100:00100000:0.0:1788869675.941149:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869675.941173:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554708224 00000100:00100000:0.0:1788869675.941177:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554708224 00000100:00100000:0.0:1788869675.941231:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554708352 00000100:00100000:0.0:1788869675.941234:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554708352 00000100:00100000:0.0:1788869675.941289:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788869675.941296:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554708224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869675.941333:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554708224:12345-0@lo:400:kworker.0 Request processed in 38us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869675.941339:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788869675.941351:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788869675.941744:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554708352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869675.941782:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554708352:12345-0@lo:400:kworker.0 Request processed in 42us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869675.941788:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1788869675.941805:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869675.941824:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554708224:0@lo:400:kworker.0 00000100:00100000:0.0:1788869675.941846:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554707968 00000100:00100000:0.0:1788869675.941850:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554707968 00000100:00100000:0.0:1788869675.941880:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554708480 00000100:00100000:0.0:1788869675.941883:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554708480 00000100:00100000:0.0:1788869675.941901:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788869675.941907:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875765554707968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869675.941938:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875765554707968:12345-0@lo:400:kworker.0 Request processed in 31us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869675.941944:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788869675.941957:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788869675.941963:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875765554708480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869675.941989:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875765554708480:12345-0@lo:400:kworker.0 Request processed in 26us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869675.942005:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:0.0:1788869675.942020:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869675.942041:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554708352:0@lo:400:kworker.0 00000100:00100000:0.0:1788869675.942051:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875765554707968:0@lo:400:kworker.0 00000100:00100000:0.0:1788869675.942059:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1875765554708480:0@lo:400:kworker.0 00000100:00100000:1.0:1788869675.943172:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869675.943289:0:9487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545181440 00000100:00100000:0.0:1788869675.943295:0:9487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545181440 00010000:00010000:0.0:1788869675.943324:0:9487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc309c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa62 expref: 45 pid: 6486 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869675.943498:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:3.0:1788869675.943511:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88011f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+45:2387:x1875765545181440:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869675.943525:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869675.943533:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc309c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa62 expref: 45 pid: 6486 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869675.943547:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc309c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa62 expref: 45 pid: 6486 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869675.943570:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc309c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa62 expref: 45 pid: 6486 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869675.943600:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:3.0:1788869675.943606:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc30d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869675.943615:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc30d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869675.943623:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc30d4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869675.943661:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869675.943706:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88011f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+44:2387:x1875765545181440:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 198us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869675.943713:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 56 00010000:00010000:2.0:1788869675.944570:0:6486:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc30d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869675.944581:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc30d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869675.944634:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788869675.944640:0:6486:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869675.944679:0:6486:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc30d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869675.944695:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc30d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869675.944704:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc30c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869675.944723:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc30c6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869675.944730:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc30c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869675.944736:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9f400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869675.944741:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc30c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869675.944748:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc30c6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869675.944758:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:2.0:1788869675.944761:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869675.944766:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc30c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869675.944772:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc30c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869675.944784:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc30cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869675.944790:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc30cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869675.944795:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc30cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869675.944800:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9f600 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869675.944808:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc30cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869675.944815:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc30cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869675.944823:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99fe831e3a00) 00010000:00010000:2.0:1788869675.944825:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869675.944828:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc30cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869675.944833:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc30cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869675.944866:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc30bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa70 expref: 44 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869675.944879:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc30d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa70 expref: 43 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869675.944886:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:2.0:1788869675.944889:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869675.944891:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9fe00, rc 0) 00000100:00100000:2.0:1788869675.944978:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+43:11203:x1875765545181056:12345-192.168.201.30@tcp:101:stat.0 Request processed in 21312us (21588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869675.944984:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 63 00010000:00010000:3.0:1788869676.056483:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869676.110702:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869676.110895:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545181696 00000100:00100000:0.0:1788869676.110916:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545181696 00000100:00100000:0.0:1788869676.110988:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:0.0:1788869676.110999:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+43:11209:x1875765545181696:12345-192.168.201.30@tcp:36:truncate.0 00010000:00010000:0.0:1788869676.111061:0:12967:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869676.111091:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc30d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa70 expref: 43 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.111110:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:0.0:1788869676.111115:0:12967:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869676.111654:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc30db lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.111671:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc30db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.111682:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc30db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869676.111748:0:12967:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1788869676.111774:0:12967:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d6ecb4b0 reply state 00000000753d36f5 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc30db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.111786:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc30db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.111792:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:0.0:1788869676.111794:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869676.111797:0:12967:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869676.112233:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+45:11209:x1875765545181696:12345-192.168.201.30@tcp:36:truncate.0 Request processed in 1233us (1539us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788869676.112242:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 64 00000020:00080000:0.0:1788869676.112247:0:12967:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1788869676.250957:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788869676.252304:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788869676.393826:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869676.393921:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545181824 00000100:00100000:0.0:1788869676.393931:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545181824 00000100:00100000:0.0:1788869676.394033:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:0.0:1788869676.394044:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+45:11223:x1875765545181824:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:0.0:1788869676.394069:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869676.394088:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2a00/0xbead52e175fc30e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaa77 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.394152:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2400/0xbead52e175fc30e9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.394167:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2400/0xbead52e175fc30e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.394217:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2400/0xbead52e175fc30e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.394243:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc30f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.394269:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc30f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.394277:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc30f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.394341:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc30f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.394350:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc30f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.399828:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc30f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869676.399889:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788869676.399894:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869676.399922:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc30f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.399938:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc30f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.399948:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2400/0xbead52e175fc30e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.399972:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2400/0xbead52e175fc30e9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.399979:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2400/0xbead52e175fc30e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.399985:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb98e2400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869676.399990:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2400/0xbead52e175fc30e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.399997:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2400/0xbead52e175fc30e9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.400009:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:0.0:1788869676.400012:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869676.400015:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2400/0xbead52e175fc30e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.400022:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2400/0xbead52e175fc30e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.400038:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc30f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.400044:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc30f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.400051:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc30f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.400055:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04c00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869676.400062:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc30f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.400069:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc30f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.400076:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99fe831e3a00) 00010000:00010000:0.0:1788869676.400079:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869676.400081:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc30f0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.400087:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc30f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.400123:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2a00/0xbead52e175fc30e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa77 expref: 47 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.400137:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc30f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa77 expref: 46 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.400144:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:0.0:1788869676.400147:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869676.400149:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb05800, rc 0) 00000100:00100000:0.0:1788869676.400248:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+46:11223:x1875765545181824:12345-192.168.201.30@tcp:101:stat.0 Request processed in 6201us (6426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869676.400296:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:1.0:1788869676.497765:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869676.498305:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545182080 00000100:00100000:2.0:1788869676.498316:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545182080 00000100:00100000:2.0:1788869676.498424:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:2.0:1788869676.498447:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+46:11233:x1875765545182080:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1788869676.498469:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869676.498557:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc30fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaa7e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869676.498661:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788869676.498760:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc30fe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa7e expref: 48 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.498774:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff88bbf300) 00010000:00010000:2.0:1788869676.498777:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788869676.498782:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc30fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa7e expref: 48 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.498797:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0800, rc 0) 00000100:00100000:2.0:1788869676.498904:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+47:11233:x1875765545182080:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 458us (1148us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1788869676.498913:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:1.0:1788869676.507864:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869676.508039:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545182336 00000100:00100000:3.0:1788869676.508048:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545182336 00000100:00100000:3.0:1788869676.508134:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:3.0:1788869676.508145:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+47:11233:x1875765545182336:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1788869676.508613:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+48:11233:x1875765545182336:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 468us (756us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1788869676.508622:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:1.0:1788869676.595418:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869676.595989:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545182592 00000100:00100000:0.0:1788869676.595999:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545182592 00000100:00100000:0.0:1788869676.596063:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:0.0:1788869676.596072:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+48:11239:x1875765545182592:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1788869676.596108:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869676.596127:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04600/0xbead52e175fc310c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaa85 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.596275:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3113 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.596291:0:12967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc30f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa77 expref: 49 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.596300:0:12967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3113 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.596333:0:12967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc30f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa77 expref: 49 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.596346:0:12967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc30f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa77 expref: 49 pid: 6484 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869676.596359:0:12967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12967:1875765554708736:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788869676.596459:0:12967:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43840 going to sleep for 11 seconds 00000100:00100000:2.0:1788869676.609847:0:12967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12967:1875765554708736:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788869676.609881:0:12967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3113 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869676.609935:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869676.610783:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545182720 00000100:00100000:2.0:1788869676.610792:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545182720 00010000:00010000:2.0:1788869676.610832:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc30f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa77 expref: 50 pid: 6484 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869676.610872:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:2.0:1788869676.610894:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89da8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+50:2388:x1875765545182720:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869676.610908:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869676.610915:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc30f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa77 expref: 50 pid: 6484 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.610927:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc30f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa77 expref: 50 pid: 6484 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.610948:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc30f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa77 expref: 50 pid: 6484 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.610964:0:9488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:2.0:1788869676.610969:0:9488:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3113 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.610979:0:9488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3113 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.610987:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3113 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.611017:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869676.611074:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89da8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+49:2388:x1875765545182720:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 179us (1140us total) trans 0 rc 0/0 00010000:00010000:3.0:1788869676.611077:0:12967:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3113 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869676.611084:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 57 00010000:00010000:3.0:1788869676.611092:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3113 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869676.611129:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788869676.611338:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04600/0xbead52e175fc310c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa85 expref: 50 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869676.611357:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3113 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa85 expref: 49 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869676.611382:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:3.0:1788869676.611385:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788869676.611388:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04800, rc 0) 00000100:00100000:3.0:1788869676.611424:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+49:11239:x1875765545182592:12345-192.168.201.30@tcp:101:bash.0 Request processed in 15353us (16026us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788869676.611432:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 67 00000001:00080000:0.0:1788869676.612987:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967343 is committed 00000004:00080000:0.0:1788869676.613021:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788869676.613044:0:6463:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffb8bdbc00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788869676.613049:0:6463:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99ffbfb40200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffb8bdbd80 00000020:00080000:0.0:1788869676.613052:0:6463:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99ffbfb40900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fe83036e00 00000020:00080000:1.0:1788869676.613293:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788869676.613600:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788869676.613869:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff8729b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554708864:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788869676.613943:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869676.614035:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554708864 00000100:00100000:3.0:1788869676.614044:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554708864 00000100:00100000:3.0:1788869676.614107:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788869676.614117:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3619:x1875765554708864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788869676.614142:0:8527:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:3.0:1788869676.614173:0:8527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9ffc2a, atime: 0x6a9ffc2b, ctime: 0x6a9ffc2a, blocks: 0x8 00010000:00010000:3.0:1788869676.614181:0:8527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc3121 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869676.614196:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=294s v=(0 0) 00010000:00010000:3.0:1788869676.614200:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869676.614206:0:8527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc3121 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869676.614231:0:8527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc3121 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869676.614239:0:8527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc3121 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869676.614246:0:8527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc3121 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869676.615077:0:8527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788869676.615238:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3619:x1875765554708864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1121us (1293us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788869676.615246:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1788869676.615361:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc2f68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.615372:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc2f68 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.615389:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc2f68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.615395:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80030c00 already unused, calling callback (ffffffffc17d84f0) 00000100:00080000:0.0:1788869676.615736:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869676.615827:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869676.615897:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545182976 00000100:00100000:0.0:1788869676.615904:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545182976 00000100:00100000:0.0:1788869676.615956:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:0.0:1788869676.615965:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+16:11239:x1875765545182976:12345-192.168.201.30@tcp:36:bash.0 00010000:00010000:0.0:1788869676.616153:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3128 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.616167:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3128 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.616177:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3128 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869676.616212:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1788869676.616230:0:6484:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002f7da856 reply state 0000000055f883af transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3128 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.616241:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3128 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.616248:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:0.0:1788869676.616274:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869676.616278:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869676.616348:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+19:11239:x1875765545182976:12345-192.168.201.30@tcp:36:bash.0 Request processed in 385us (523us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1788869676.616355:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 68 00000020:00080000:0.0:1788869676.616358:0:6484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788869676.616771:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869676.616778:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc3121 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869676.616788:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535400 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869676.616793:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc3121 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869676.616803:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc3121 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869676.616820:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc3121 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869676.616836:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc3121 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869676.616863:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869676.616864:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869676.616866:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788869676.616901:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ff8729b100/2, rc 0, transno 4294967302 00000100:00100000:3.0:1788869676.616908:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff8729b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554708864:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788869676.617499:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc2f68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617509:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc2f68 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617521:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99fe831e3700) 00010000:00010000:2.0:1788869676.617524:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869676.617527:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc2f68 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617533:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc2f68 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617551:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc2f6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617558:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc2f6f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617564:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc2f6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617569:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869676.617571:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc2f6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617589:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc2f6f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617598:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:2.0:1788869676.617601:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869676.617604:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc2f6f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617610:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc2f6f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617625:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc2fae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617632:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc2fae lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617638:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc2fae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617642:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031e00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869676.617645:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc2fae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617651:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc2fae lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617658:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99fe831e3a00) 00010000:00010000:2.0:1788869676.617660:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869676.617662:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc2fae lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617672:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc2fae lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617696:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3a00/0xbead52e175fc30b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617703:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3a00/0xbead52e175fc30b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617710:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3a00/0xbead52e175fc30b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617715:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb98e3a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869676.617719:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3a00/0xbead52e175fc30b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617726:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3a00/0xbead52e175fc30b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617734:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:2.0:1788869676.617736:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869676.617739:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3a00/0xbead52e175fc30b8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617745:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3a00/0xbead52e175fc30b8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617754:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc30db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617760:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc30db lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617770:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc30db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617775:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb98e3000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869676.617778:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc30db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617785:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc30db lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617792:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:2.0:1788869676.617794:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869676.617797:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc30db lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.617802:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3000/0xbead52e175fc30db lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869676.623881:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869676.624240:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545183104 00000100:00100000:2.0:1788869676.624270:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545183104 00000100:00100000:2.0:1788869676.624335:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:2.0:1788869676.624346:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+15:11239:x1875765545183104:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1788869676.624371:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869676.624407:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc312f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaa8c expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.624503:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc3136 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.624517:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3113 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa85 expref: 16 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.624539:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc3136 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.624573:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3113 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa85 expref: 16 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.624586:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3113 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa85 expref: 16 pid: 12967 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869676.624599:0:6486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb10000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6486:1875765554708992:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788869676.624678:0:6486:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff85566f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869676.627099:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869676.627408:0:6486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb10000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6486:1875765554708992:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788869676.627432:0:6486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc3136 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869676.627494:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545183232 00000100:00100000:3.0:1788869676.627501:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545183232 00010000:00010000:3.0:1788869676.627540:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3113 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa85 expref: 17 pid: 12967 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869676.627617:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:3.0:1788869676.627626:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+17:2387:x1875765545183232:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869676.627792:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869676.627802:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3113 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa85 expref: 17 pid: 12967 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869676.627814:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3113 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa85 expref: 17 pid: 12967 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869676.627837:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3113 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa85 expref: 17 pid: 12967 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869676.627852:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:3.0:1788869676.627869:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc3136 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869676.627881:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc3136 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869676.627888:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc3136 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869676.627926:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869676.627977:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+16:2387:x1875765545183232:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 351us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869676.627985:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 58 00010000:00010000:2.0:1788869676.628077:0:6486:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc3136 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.628084:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc3136 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869676.628132:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788869676.628138:0:6486:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869676.628160:0:6486:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc3136 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.628205:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc312f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa8c expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.628232:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc3136 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa8c expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.628239:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:2.0:1788869676.628242:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869676.628245:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0a00, rc 0) 00000100:00100000:2.0:1788869676.628301:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+15:11239:x1875765545183104:12345-192.168.201.30@tcp:101:bash.0 Request processed in 3957us (4433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869676.628308:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:1.0:1788869676.636557:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869676.637815:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545183488 00000100:00100000:2.0:1788869676.637827:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545183488 00000100:00100000:2.0:1788869676.637886:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:2.0:1788869676.637896:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+15:11239:x1875765545183488:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:2.0:1788869676.638112:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+16:11239:x1875765545183488:12345-192.168.201.30@tcp:35:bash.0 Request processed in 217us (1565us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788869676.638120:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:1.0:1788869676.760338:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869676.760440:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545183744 00000100:00100000:3.0:1788869676.760451:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545183744 00000100:00100000:3.0:1788869676.760512:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:3.0:1788869676.760522:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+16:11249:x1875765545183744:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869676.760550:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869676.760570:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc313d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaa93 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869676.760672:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788869676.760782:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc313d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa93 expref: 18 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869676.760798:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff88bbf300) 00010000:00010000:3.0:1788869676.760801:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869676.760807:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc313d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa93 expref: 18 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869676.760840:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81535400, rc 0) 00000100:00100000:3.0:1788869676.760904:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+17:11249:x1875765545183744:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 383us (576us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1788869676.760912:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:1.0:1788869676.762973:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869676.763055:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545183872 00000100:00100000:0.0:1788869676.763063:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545183872 00000100:00100000:0.0:1788869676.763124:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00100000:0.0:1788869676.763133:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+17:11249:x1875765545183872:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:0.0:1788869676.763211:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc314b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763227:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc314b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763239:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc314b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763278:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3152 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763287:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3152 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763294:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3152 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763365:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3159 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763374:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763596:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869676.763646:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763660:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc314b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763673:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc314b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763679:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc314b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763686:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869676.763691:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc314b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763698:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc314b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763710:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:0.0:1788869676.763712:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869676.763717:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc314b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763787:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc314b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763800:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3152 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763807:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3152 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763813:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3152 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763818:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869676.763826:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3152 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763832:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3152 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763840:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99fe821d6700) 00010000:00010000:0.0:1788869676.763843:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869676.763846:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3152 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763852:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3152 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763865:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763872:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3159 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763878:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3159 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763883:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869676.763885:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3159 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763891:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3159 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763897:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:0.0:1788869676.763899:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869676.763906:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3159 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.763912:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3159 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869676.764026:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+17:11249:x1875765545183872:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 892us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869676.764034:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00100000:2.0:1788869676.768456:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869676.768613:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545184128 00000100:00100000:1.0:1788869676.768626:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545184128 00000100:00100000:1.0:1788869676.768682:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:1.0:1788869676.768694:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+17:11249:x1875765545184128:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:1.0:1788869676.768914:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+18:11249:x1875765545184128:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 222us (468us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788869676.768922:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:1.0:1788869676.800769:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869676.800868:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545184384 00000100:00100000:2.0:1788869676.800881:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545184384 00000100:00100000:2.0:1788869676.801089:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:2.0:1788869676.801101:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+18:11252:x1875765545184384:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1788869676.801128:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869676.801149:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3160 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaa9a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801291:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3167 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801306:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3167 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801317:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3167 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801332:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc316e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801339:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc316e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801346:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc316e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801478:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3175 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801488:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3175 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801496:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3175 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869676.801507:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788869676.801581:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3167 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801588:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3167 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801601:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3167 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801607:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1e00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869676.801611:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3167 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801619:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3167 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801631:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:2.0:1788869676.801634:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869676.801638:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3167 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801644:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3167 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801657:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc316e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801663:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc316e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801669:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc316e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801674:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869676.801677:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc316e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801693:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc316e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801701:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99ffb89e1f00) 00010000:00010000:2.0:1788869676.801703:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869676.801706:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc316e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801712:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc316e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801752:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3160 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa9a expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801765:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3175 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa9a expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869676.801772:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:2.0:1788869676.801774:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869676.801777:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0200, rc 0) 00000100:00100000:2.0:1788869676.801983:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+20:11252:x1875765545184384:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 883us (1225us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788869676.801991:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:0.0:1788869676.806955:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869676.807094:0:9487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545184512 00000100:00100000:1.0:1788869676.807104:0:9487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545184512 00000100:00100000:1.0:1788869676.807177:0:9487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:1.0:1788869676.807187:0:9487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4fff62-1855-4361-a244-1a23eb291d37+20:2387:x1875765545184512:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869676.807212:0:9487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869676.807239:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3175 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa9a expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869676.807294:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:1.0:1788869676.807300:0:9487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869676.807344:0:9487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4fff62-1855-4361-a244-1a23eb291d37+19:2387:x1875765545184512:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 159us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869676.807352:0:9487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:1.0:1788869676.810172:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869676.810408:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545184640 00000100:00100000:0.0:1788869676.810419:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545184640 00000100:00100000:0.0:1788869676.810474:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00100000:0.0:1788869676.810484:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+19:11252:x1875765545184640:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:0.0:1788869676.810552:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3183 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.810569:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.810581:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.810621:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.810628:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3183 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.810636:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3183 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.810653:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869676.810659:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3183 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.810667:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3183 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.810680:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:0.0:1788869676.810683:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788869676.810687:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3183 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869676.810693:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3183 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869676.810777:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+19:11252:x1875765545184640:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 294us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869676.810785:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00100000:0.0:1788869676.815955:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869676.816030:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545184896 00000100:00100000:3.0:1788869676.816040:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545184896 00000100:00100000:3.0:1788869676.816107:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:3.0:1788869676.816116:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+19:11252:x1875765545184896:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1788869676.816382:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+20:11252:x1875765545184896:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 260us (428us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788869676.816391:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:2.0:1788869677.024484:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869677.024852:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545185152 00000100:00100000:0.0:1788869677.024862:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545185152 00000100:00100000:0.0:1788869677.025207:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 74 00000100:00100000:0.0:1788869677.025219:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+20:11270:x1875765545185152:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:0.0:1788869677.025242:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869677.025290:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc318a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaaa1 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.025435:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc3191 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.025458:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc3191 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.025470:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc3191 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869677.025483:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788869677.025709:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc318a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaa1 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.025727:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc3191 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaa1 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.025736:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:0.0:1788869677.025739:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788869677.025742:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04200, rc 0) 00000100:00100000:0.0:1788869677.025800:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+22:11270:x1875765545185152:12345-192.168.201.30@tcp:101:cat.0 Request processed in 583us (1324us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1788869677.025806:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 74 00000100:00080000:2.0:1788869677.026045:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869677.057914:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869677.058073:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545185280 00000100:00100000:3.0:1788869677.058083:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545185280 00000100:00100000:3.0:1788869677.058140:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 75 00000100:00100000:3.0:1788869677.058150:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+22:11271:x1875765545185280:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869677.058175:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869677.058198:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc319f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaaa8 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.058303:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc31a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.058317:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc31a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.058328:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc31a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869677.058390:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788869677.058393:0:6486:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869677.058420:0:6486:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc31a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.058446:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc319f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaa8 expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.058465:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc31a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaa8 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.058473:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:3.0:1788869677.058476:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869677.058480:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534a00, rc 0) 00000100:00100000:3.0:1788869677.058541:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+23:11271:x1875765545185280:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 393us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869677.058548:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 75 00000100:00100000:1.0:1788869677.065347:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869677.065443:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545185664 00000100:00100000:3.0:1788869677.065454:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545185664 00000100:00100000:3.0:1788869677.065510:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:3.0:1788869677.065520:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+23:11271:x1875765545185664:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1788869677.065807:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+24:11271:x1875765545185664:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 288us (467us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788869677.065815:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:2.0:1788869677.072666:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869677.072800:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545185792 00000100:00100000:0.0:1788869677.072809:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545185792 00000100:00100000:0.0:1788869677.072873:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:0.0:1788869677.072883:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+24:11271:x1875765545185792:12345-192.168.201.30@tcp:103:lfs.0 00010000:00010000:0.0:1788869677.072897:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788869677.072921:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc3136 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa8c expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.072971:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc3191 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaa1 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.072984:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e2200/0xbead52e175fc302c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa46 expref: 22 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.072994:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:0.0:1788869677.072998:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869677.073056:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+21:11271:x1875765545185792:12345-192.168.201.30@tcp:103:lfs.0 Request processed in 174us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869677.073064:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:2.0:1788869677.075342:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869677.075570:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545185920 00000100:00100000:1.0:1788869677.075579:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545185920 00000100:00100000:1.0:1788869677.075630:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 76 00000100:00100000:1.0:1788869677.075639:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+21:11271:x1875765545185920:12345-192.168.201.30@tcp:58:lfs.0 00010000:00010000:1.0:1788869677.075754:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc31ad lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.075770:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc31ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.075784:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc31ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788869677.076006:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788869677.076127:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788869677.076481:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788869677.076606:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+21:11271:x1875765545185920:12345-192.168.201.30@tcp:58:lfs.0 Request processed in 966us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869677.076615:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 76 00010000:00010000:0.0:1788869677.080527:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869677.099826:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869677.099893:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545186048 00000100:00100000:0.0:1788869677.099903:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545186048 00000100:00100000:0.0:1788869677.099976:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 77 00000100:00100000:0.0:1788869677.099986:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+21:11273:x1875765545186048:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1788869677.100008:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869677.100028:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc31b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaaaf expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100094:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc31bb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100109:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc31bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100120:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc31bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100142:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05a00/0xbead52e175fc31c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100150:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05a00/0xbead52e175fc31c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100157:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05a00/0xbead52e175fc31c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100226:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc31c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100235:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc31c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100243:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc31c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869677.100311:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788869677.100315:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869677.100333:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc31c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100345:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc31c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100353:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc31bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100360:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc31bb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100388:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc31bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100396:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869677.100410:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc31bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100418:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc31bb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100430:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:0.0:1788869677.100433:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869677.100437:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc31bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100444:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc31bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100458:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05a00/0xbead52e175fc31c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100464:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05a00/0xbead52e175fc31c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100469:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05a00/0xbead52e175fc31c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100475:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869677.100478:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05a00/0xbead52e175fc31c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100493:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05a00/0xbead52e175fc31c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100501:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99fe821d6700) 00010000:00010000:0.0:1788869677.100503:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869677.100506:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05a00/0xbead52e175fc31c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100511:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05a00/0xbead52e175fc31c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100543:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc31b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaaf expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100557:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc31c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaaf expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.100564:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:0.0:1788869677.100567:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869677.100569:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb05400, rc 0) 00000100:00100000:0.0:1788869677.100631:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+22:11273:x1875765545186048:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 646us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869677.100639:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 77 00000040:00080000:1.0:1788869677.274846:0:13761:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788869677.274856:0:13761:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788869677.274903:0:13761:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788869677.274912:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788869677.275065:0:13761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84f01c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1875765554709120:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788869677.275176:0:13761:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff87384840 going to sleep for 11 seconds 00000100:00100000:2.0:1788869677.290503:0:13761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84f01c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1875765554709120:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788869677.306219:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869677.306419:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545186176 00000100:00100000:0.0:1788869677.306430:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545186176 00000100:00100000:0.0:1788869677.306495:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:0.0:1788869677.306505:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+22:11284:x1875765545186176:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788869677.306556:0:9496:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788869677.306816:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+22:11284:x1875765545186176:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 311us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869677.306824:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:1.0:1788869677.315201:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869677.315342:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545186304 00000100:00100000:3.0:1788869677.315352:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545186304 00000100:00100000:3.0:1788869677.315436:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00100000:3.0:1788869677.315447:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+22:11284:x1875765545186304:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788869677.315524:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc31d0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.315542:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc31d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.315555:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc31d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317002:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc31d7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317022:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc31d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317032:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc31d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317070:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc31de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317080:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc31de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317087:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc31de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869677.317137:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788869677.317143:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869677.317159:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc31de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317188:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc31d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317194:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc31d0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317201:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc31d0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317207:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869677.317211:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc31d0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317219:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc31d0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317232:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffb89e0700) 00010000:00010000:3.0:1788869677.317235:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869677.317240:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc31d0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317247:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc31d0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317280:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc31d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317287:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc31d7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317292:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc31d7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317304:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869677.317308:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc31d7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317313:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc31d7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317322:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff99ff88bbf500) 00010000:00010000:3.0:1788869677.317324:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869677.317327:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc31d7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317332:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc31d7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317356:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc31de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317362:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc31de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317368:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc31de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317373:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869677.317376:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc31de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317383:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc31de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317416:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:3.0:1788869677.317419:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869677.317422:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc31de lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.317429:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc31de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869677.317528:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+22:11284:x1875765545186304:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 Request processed in 2078us (2332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869677.317539:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00100000:1.0:1788869677.326759:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869677.326839:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545186560 00000100:00100000:3.0:1788869677.326849:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545186560 00000100:00100000:3.0:1788869677.326916:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 80 00000100:00100000:3.0:1788869677.326927:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+22:11284:x1875765545186560:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869677.326949:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869677.326973:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc31e5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaab6 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.327093:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc31ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.327120:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc31ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.327132:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc31ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869677.327145:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788869677.327278:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc31ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.327286:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc31ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.327293:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc31ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.327299:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fe00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869677.327304:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc31ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.327318:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc31ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.327332:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:3.0:1788869677.327335:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869677.327339:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc31ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.327346:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc31ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.327389:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc31e5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaab6 expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.327409:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffb89e0700) 00010000:00010000:3.0:1788869677.327412:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869677.327416:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc31e5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaab6 expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.327515:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534600, rc 0) 00000100:00100000:3.0:1788869677.327578:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+23:11284:x1875765545186560:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 652us (828us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1788869677.327587:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 80 00000100:00100000:1.0:1788869677.333387:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869677.337605:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545186688 00000100:00100000:3.0:1788869677.337622:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545186688 00000100:00100000:3.0:1788869677.337693:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00100000:3.0:1788869677.337703:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+23:11284:x1875765545186688:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788869677.337741:0:12967:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788869677.337929:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+23:11284:x1875765545186688:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 227us (4549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869677.337937:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00100000:1.0:1788869677.342966:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869677.343052:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545186944 00000100:00100000:3.0:1788869677.343063:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545186944 00000100:00100000:3.0:1788869677.343126:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 82 00000100:00100000:3.0:1788869677.343136:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+23:11284:x1875765545186944:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869677.343157:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869677.343160:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788869677.343186:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc31a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaa8 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.343340:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:3.0:1788869677.343346:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869677.343361:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc31fa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaabd expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788869677.344379:0:6484:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788869677.344566:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3201 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.344581:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3201 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.344591:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3201 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.344658:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc31fa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaabd expref: 25 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.344681:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3201 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaabd expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.344690:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99ff88bbf500) 00010000:00010000:3.0:1788869677.344693:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869677.344696:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9ee00, rc 0) 00000100:00100000:3.0:1788869677.344767:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+24:11284:x1875765545186944:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 1631us (1812us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788869677.344790:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 82 00000100:00100000:2.0:1788869677.357375:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869677.358112:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545187200 00000100:00100000:1.0:1788869677.358124:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545187200 00000100:00100000:1.0:1788869677.358246:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 83 00000100:00100000:1.0:1788869677.358285:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+24:11284:x1875765545187200:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788869677.358358:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869677.358386:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3201 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaabd expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.358413:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99ff88bbf500) 00010000:00010000:1.0:1788869677.358430:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869677.358454:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8800/0xbead52e175fc320f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.358471:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8800/0xbead52e175fc320f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.358691:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8800/0xbead52e175fc320f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.358710:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc3216 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x69cfa7cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.358717:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc3216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x69cfa7cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.358723:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc3216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x69cfa7cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.358789:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8800/0xbead52e175fc320f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.358796:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8800/0xbead52e175fc320f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.358803:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8800/0xbead52e175fc320f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.358808:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a8800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869677.358812:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8800/0xbead52e175fc320f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.358820:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8800/0xbead52e175fc320f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.358828:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:1.0:1788869677.358831:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869677.358834:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8800/0xbead52e175fc320f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.358840:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8800/0xbead52e175fc320f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.358849:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc3216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x69cfa7cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.358854:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc3216 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x69cfa7cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.358859:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc3216 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x69cfa7cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.358870:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a8400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869677.358873:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc3216 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x69cfa7cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.358879:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc3216 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x69cfa7cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.358887:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x69cfa7cf (ffff99fe831e3900) 00010000:00010000:1.0:1788869677.358889:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869677.358892:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc3216 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x69cfa7cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.358898:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc3216 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x69cfa7cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869677.359006:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+23:11284:x1875765545187200:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 723us (1641us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788869677.359014:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 83 00000100:00100000:3.0:1788869677.366740:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869677.366792:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545187328 00000100:00100000:1.0:1788869677.366802:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545187328 00000100:00100000:1.0:1788869677.366861:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00100000:1.0:1788869677.366872:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff87298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+23:11284:x1875765545187328:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869677.366903:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869677.366927:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc321d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaac4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.366969:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3224 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.367002:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.367015:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3224 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.367133:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc321d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaac4 expref: 25 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.367171:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3224 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaac4 expref: 24 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.367181:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99fe831e3600) 00010000:00010000:1.0:1788869677.367184:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788869677.367188:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80031a00, rc 0) 00000100:00100000:1.0:1788869677.367248:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff87298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+24:11284:x1875765545187328:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 379us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869677.367277:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00100000:2.0:1788869677.373716:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869677.373876:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545187584 00000100:00100000:3.0:1788869677.373886:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545187584 00000100:00100000:3.0:1788869677.373943:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 85 00000100:00100000:3.0:1788869677.373952:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+24:11284:x1875765545187584:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788869677.374041:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc322b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.374057:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc322b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.374067:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc322b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788869677.374232:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788869677.374242:0:6484:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 295300988416ns, next at 296300985869ns, rc = 0 00000004:00010000:3.0:1788869677.375610:0:6484:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b50c33d9 reply state 00000000f5b79c99 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc322b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.375631:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc322b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.375640:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99fe831e3600) 00010000:00010000:3.0:1788869677.375643:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788869677.375646:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788869677.375761:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+26:11284:x1875765545187584:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 1807us (2049us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788869677.375770:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 85 00000100:00100000:2.0:1788869677.380025:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869677.381201:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545187712 00000100:00100000:1.0:1788869677.381339:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545187712 00000100:00100000:1.0:1788869677.381409:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 86 00000100:00100000:1.0:1788869677.381420:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+26:11284:x1875765545187712:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869677.381448:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869677.381473:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3232 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaacb expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.381614:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3232 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaacb expref: 27 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.381640:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3232 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaacb expref: 27 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.381660:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99fe831e3600) 00010000:00010000:1.0:1788869677.381664:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869677.381667:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80030c00, rc 0) 00000100:00100000:1.0:1788869677.381730:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+27:11284:x1875765545187712:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 311us (1721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869677.381737:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 86 00000100:00100000:3.0:1788869677.384816:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869677.384902:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545187840 00000100:00100000:0.0:1788869677.384911:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545187840 00000100:00100000:0.0:1788869677.384966:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:0.0:1788869677.384974:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2386:x1875765545187840:12345-192.168.201.30@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788869677.385005:0:8401:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp t0 exp 0000000000000000 cur 295 last 0 00000020:00000080:0.0:1788869677.385038:0:8401:0:(genops.c:1406:class_connect()) connect: client bf4fff62-1855-4361-a244-1a23eb291d37, cookie 0xbead52e175fc3239 00002000:00100000:0.0:1788869677.385051:0:8401:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bf4fff62-1855-4361-a244-1a23eb291d37/ffff99fe81cb2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788869677.385069:0:8401:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788869677.385144:0:8401:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788869677.385172:0:8401:0:(import.c:65:import_set_state_nolock()) ffff99ff8554e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869677.385282:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+6:2386:x1875765545187840:12345-192.168.201.30@tcp:8:lhsmtool_posix.0 Request processed in 306us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869677.385289:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:2.0:1788869677.388578:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869677.388656:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545187968 00000100:00100000:3.0:1788869677.388666:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545187968 00000100:00100000:3.0:1788869677.388745:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:3.0:1788869677.388752:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf4fff62-1855-4361-a244-1a23eb291d37+6:0:x1875765545187968:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788869677.388919:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788869677.407598:0:8393:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:3.0:1788869677.407621:0:8393:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bf4fff62-1855-4361-a244-1a23eb291d37 00000100:00100000:0.0:1788869677.407826:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:0:x1875765545187968:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 19067us (19249us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788869677.407839:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:3.0:1788869677.413591:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869677.419017:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545188224 00000100:00100000:0.0:1788869677.419032:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545188224 00000100:00100000:0.0:1788869677.419104:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:0.0:1788869677.419116:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+27:11284:x1875765545188224:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788869677.419395:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+28:11284:x1875765545188224:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 279us (5811us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1788869677.419415:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:0.0:1788869677.429671:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869677.432145:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545188480 00000100:00100000:1.0:1788869677.432159:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545188480 00000100:00100000:1.0:1788869677.432239:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 87 00000100:00100000:1.0:1788869677.432287:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+28:11284:x1875765545188480:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788869677.432430:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+28:11284:x1875765545188480:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 180us (2767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869677.432438:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 87 00000100:00100000:0.0:1788869677.439745:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869677.439965:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545188608 00000100:00100000:3.0:1788869677.439975:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545188608 00000100:00100000:3.0:1788869677.440042:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 88 00000100:00100000:3.0:1788869677.440054:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+28:11284:x1875765545188608:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869677.440078:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869677.440111:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3240 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaad2 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.440196:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3247 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.440211:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.440222:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869677.440303:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869677.440326:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.440355:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3240 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaad2 expref: 30 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.440374:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3247 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaad2 expref: 29 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.440382:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99fe831e3600) 00010000:00010000:3.0:1788869677.440409:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788869677.440413:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9f400, rc 0) 00000100:00100000:3.0:1788869677.440590:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+29:11284:x1875765545188608:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 537us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869677.440598:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 88 00000100:00100000:2.0:1788869677.459099:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869677.459194:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545188736 00000100:00100000:0.0:1788869677.459206:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545188736 00000100:00100000:0.0:1788869677.459285:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:0.0:1788869677.459298:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545188736:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869677.459318:0:8401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869677.459340:0:8401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc324e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaad9 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788869677.459368:0:8401:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ffc2e, blocks: 0x0 00010000:00010000:0.0:1788869677.459387:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=295s v=(0 0) 00010000:00010000:0.0:1788869677.459391:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869677.459411:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc324e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaad9 expref: 6 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.459434:0:8401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc324e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaad9 expref: 6 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.459449:0:8401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04400, rc 0) 00000100:00100000:0.0:1788869677.459521:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+6:2387:x1875765545188736:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 226us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869677.459553:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:0.0:1788869677.470024:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869677.470107:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545188992 00000100:00100000:3.0:1788869677.470117:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545188992 00000100:00100000:3.0:1788869677.470213:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 89 00000100:00100000:3.0:1788869677.470224:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+29:11284:x1875765545188992:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788869677.470363:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+29:11284:x1875765545188992:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 140us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869677.470371:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 89 00000100:00100000:2.0:1788869677.477746:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869677.477878:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545189120 00000100:00100000:0.0:1788869677.477890:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545189120 00000100:00100000:0.0:1788869677.477959:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:0.0:1788869677.477971:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:11284:x1875765545189120:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869677.477993:0:8399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869677.478013:0:8399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000075b6ffc/0xbead52e175fc3255 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaae0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.478048:0:8399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc324e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaad9 expref: 7 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.478057:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869677.478062:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869677.478067:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000075b6ffc/0xbead52e175fc3255 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaae0 expref: 7 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.478105:0:8399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc324e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaad9 expref: 7 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.478118:0:8399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc324e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaad9 expref: 7 pid: 8401 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869677.478132:0:8399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8399:1875765554709248:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788869677.478248:0:8399:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c439c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869677.490011:0:8399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8399:1875765554709248:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869677.490125:0:8399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000075b6ffc/0xbead52e175fc3255 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaae0 expref: 7 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.490146:0:8399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb05000, rc 0) 00000100:00100000:3.0:1788869677.490215:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+7:11284:x1875765545189120:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 12245us (12478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869677.490224:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:1.0:1788869677.490381:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869677.491737:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545189248 00000100:00100000:3.0:1788869677.491747:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545189248 00010000:00010000:3.0:1788869677.491790:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc324e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaad9 expref: 7 pid: 8401 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869677.491842:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:3.0:1788869677.491870:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+7:2388:x1875765545189248:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869677.491899:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869677.491921:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc324e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaad9 expref: 7 pid: 8401 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.491941:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc324e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaad9 expref: 7 pid: 8401 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.491963:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc324e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaad9 expref: 7 pid: 8401 timeout: 395 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.491979:0:6471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869677.491983:0:6471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869677.491991:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000075b6ffc/0xbead52e175fc3255 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaae0 expref: 6 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.492003:0:6471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000075b6ffc/0xbead52e175fc3255 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaae0 expref: 6 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.492053:0:6471:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000075b6ffc/0xbead52e175fc3255 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaae0 expref: 6 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869677.492067:0:6471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6471:1875765554709376:192.168.201.30@tcp:105: 00000100:00100000:3.0:1788869677.492151:0:6471:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8bdb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869677.503806:0:6471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6471:1875765554709376:192.168.201.30@tcp:105: 00000100:00100000:2.0:1788869677.503838:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788869677.503852:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869677.504073:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545189376 00000100:00100000:1.0:1788869677.504080:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545189376 00002000:00100000:1.0:1788869677.504126:0:8406:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff99ffbfb12d80 x1875765545189376/t0(0) o4->bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp:623/0 lens 504/0 e 0 to 0 dl 1788869688 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788869677.504137:0:8406:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffbfb12d80 with x1875765545189376 ext(0->8) 00002000:00010000:1.0:1788869677.504141:0:8406:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffbfb12d80 00000100:00100000:1.0:1788869677.504178:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:1.0:1788869677.504189:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf4fff62-1855-4361-a244-1a23eb291d37+7:2387:x1875765545189376:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788869677.504824:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+9:2388:x1875765545189248:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 12954us (14443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869677.504834:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:1.0:1788869677.509949:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf4fff62-1855-4361-a244-1a23eb291d37+8:2387:x1875765545189376:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 Request processed in 5749us (6101us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788869677.509965:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00002000:00100000:1.0:1788869677.509980:0:8406:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff99ffbfb12d80 x1875765545189376/t4294967303(0) o4->bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp:623/0 lens 504/448 e 0 to 0 dl 1788869688 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788869677.509990:0:8406:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffbfb12d80 with x1875765545189376 ext(0->8) 00002000:00010000:1.0:1788869677.509997:0:8406:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffbfb12d80 00000100:00100000:0.0:1788869677.520187:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869677.520291:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545189504 00000100:00100000:1.0:1788869677.520301:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545189504 00000100:00100000:1.0:1788869677.520360:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 90 00000100:00100000:1.0:1788869677.520371:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+29:11284:x1875765545189504:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788869677.523858:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1788869677.523875:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788869677.523902:0:6463:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1788869677.523985:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788869677.523996:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788869677.524012:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84f01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554709504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788869677.524080:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788869677.524666:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3128 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.524679:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3128 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.524695:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3128 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.524702:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04e00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869677.524708:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3128 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.524716:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3128 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.524732:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:0.0:1788869677.524735:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869677.524740:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3128 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.524747:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3128 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.524765:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc322b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.524782:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc322b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.524799:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc322b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.524805:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fe00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869677.524808:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc322b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.524814:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc322b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.524824:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99fe831e3600) 00010000:00010000:0.0:1788869677.524826:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788869677.524829:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc322b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.524833:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc322b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869677.524857:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554709504 00000100:00100000:0.0:1788869677.524863:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554709504 00000100:00100000:0.0:1788869677.524905:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788869677.524911:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554709504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788869677.525016:0:8401:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788869677.525019:0:8401:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788869678 00002000:00010000:0.0:1788869677.525021:0:8401:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788869677.525022:0:8401:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788869678 -> 1788869678 00002000:00010000:0.0:1788869677.525024:0:8401:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788869677.525058:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3616:x1875765554709504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 147us (977us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788869677.525072:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788869677.525090:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788869677.525119:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ff84f01880/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788869677.525124:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84f01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554709504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788869677.526014:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+14:11284:x1875765545189504:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 Request processed in 5639us (5831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869677.526025:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 90 00000100:00100000:1.0:1788869677.535678:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869677.535916:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545189632 00000100:00100000:3.0:1788869677.535927:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545189632 00000100:00100000:3.0:1788869677.535994:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:3.0:1788869677.536005:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf4fff62-1855-4361-a244-1a23eb291d37+8:2388:x1875765545189632:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788869677.537928:0:8393:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1788869677.537941:0:8393:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1788869677.538413:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf4fff62-1855-4361-a244-1a23eb291d37+6:2388:x1875765545189632:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 Request processed in 2395us (2731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869677.538425:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:3.0:1788869677.551644:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869677.553126:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545189888 00000100:00100000:2.0:1788869677.553140:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545189888 00000100:00100000:2.0:1788869677.553207:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 91 00000100:00100000:2.0:1788869677.553220:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+14:11284:x1875765545189888:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788869677.553322:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869677.553350:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3247 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaad2 expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.553368:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99fe831e3600) 00010000:00010000:2.0:1788869677.553373:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869677.553419:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc325c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.553434:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc325c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.553444:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc325c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869677.553574:0:6484:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004b47cb27 reply state 000000003722c604 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc325c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.553593:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc325c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.553599:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99fe831e3600) 00010000:00010000:2.0:1788869677.553602:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788869677.553605:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869677.553712:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+15:11284:x1875765545189888:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 494us (2085us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1788869677.553720:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 91 00000100:00100000:1.0:1788869677.559077:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869677.563058:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545190016 00000100:00100000:0.0:1788869677.563075:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545190016 00000100:00100000:3.0:1788869677.563845:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:3.0:1788869677.563862:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2387:x1875765545190016:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788869677.564028:0:8400:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788869677.564032:0:8400:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788869678 -> 1788869677 00002000:00010000:3.0:1788869677.564035:0:8400:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788869675 00002000:00010000:3.0:1788869677.564037:0:8400:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788869678 -> 1788869677 00002000:00010000:3.0:1788869677.564039:0:8400:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788869677.564114:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+7:2387:x1875765545190016:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 257us (5047us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788869677.564122:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:3.0:1788869677.580280:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869677.580321:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545190272 00000100:00100000:3.0:1788869677.580332:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545190272 00000100:00100000:3.0:1788869677.580395:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 92 00000100:00100000:3.0:1788869677.580414:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+15:11284:x1875765545190272:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788869677.580505:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3263 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.580522:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3224 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaac4 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.580534:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3263 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.580570:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3224 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaac4 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.580584:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3224 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaac4 expref: 15 pid: 6485 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869677.580598:0:6486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a32d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6486:1875765554709632:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869677.580678:0:6486:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8bdb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869677.592052:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869677.593292:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545190400 00000100:00100000:2.0:1788869677.593305:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545190400 00010000:00010000:2.0:1788869677.593354:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3224 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaac4 expref: 16 pid: 6485 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869677.593369:0:6486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a32d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6486:1875765554709632:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788869677.593412:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:2.0:1788869677.593422:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+16:2387:x1875765545190400:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869677.593438:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869677.593445:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3224 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaac4 expref: 16 pid: 6485 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.593457:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3224 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaac4 expref: 16 pid: 6485 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.593485:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3224 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaac4 expref: 16 pid: 6485 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.603879:0:6486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3263 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.603879:0:9488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99fe831e3600) 00010000:00010000:2.0:1788869677.603977:0:9488:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3263 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.603993:0:9488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3263 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.604001:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3263 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869677.604110:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869677.604207:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+15:2387:x1875765545190400:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 10771us (12159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869677.604229:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 60 00010000:00010000:2.0:1788869677.605397:0:6486:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3263 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.605437:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3263 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.605475:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3263 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.605481:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3263 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.605489:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3263 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.605495:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9f600 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869677.605499:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3263 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.605506:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3263 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.605519:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99fe831e3600) 00010000:00010000:2.0:1788869677.605522:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788869677.605539:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3263 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.605546:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3263 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869677.605729:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+14:11284:x1875765545190272:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 Request processed in 25315us (25472us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788869677.605738:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 92 00000100:00100000:3.0:1788869677.621315:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869677.621509:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545190528 00000100:00100000:1.0:1788869677.621519:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545190528 00000100:00100000:1.0:1788869677.621597:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:1.0:1788869677.621608:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+7:2388:x1875765545190528:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788869677.621655:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc326a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.621675:0:8399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000075b6ffc/0xbead52e175fc3255 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaae0 expref: 7 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.621694:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869677.621699:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788869677.621704:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc326a lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.621739:0:8399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000075b6ffc/0xbead52e175fc3255 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaae0 expref: 7 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.621754:0:8399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000075b6ffc/0xbead52e175fc3255 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaae0 expref: 7 pid: 8399 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869677.621771:0:8399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84f02680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8399:1875765554709760:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788869677.621855:0:8399:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8aa5900 going to sleep for 11 seconds 00000100:00100000:3.0:1788869677.633297:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869677.633524:0:8399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84f02680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8399:1875765554709760:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788869677.633554:0:8399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc326a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869677.633914:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545190656 00000100:00100000:2.0:1788869677.633923:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545190656 00010000:00010000:2.0:1788869677.633964:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000075b6ffc/0xbead52e175fc3255 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaae0 expref: 8 pid: 8399 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869677.634009:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:2.0:1788869677.634019:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+8:2387:x1875765545190656:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869677.634034:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869677.634057:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000075b6ffc/0xbead52e175fc3255 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaae0 expref: 8 pid: 8399 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.634069:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000075b6ffc/0xbead52e175fc3255 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaae0 expref: 8 pid: 8399 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.634092:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000075b6ffc/0xbead52e175fc3255 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaae0 expref: 8 pid: 8399 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.634108:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869677.634112:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869677.634133:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc326a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.634144:0:6469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc326a lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.634171:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869677.634220:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+7:2387:x1875765545190656:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 202us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869677.634228:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 61 00010000:00010000:2.0:1788869677.634250:0:8399:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc326a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.634274:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc326a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.634293:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc326a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.634301:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc326a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.634309:0:8399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc326a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.634316:0:8399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031200 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869677.634320:0:8399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc326a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.634334:0:8399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc326a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.634347:0:8399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc326a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.634355:0:8399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc326a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869677.634414:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:2388:x1875765545190528:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 Request processed in 12809us (13107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869677.634422:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:2.0:1788869677.642065:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869677.644190:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545190912 00000100:00100000:3.0:1788869677.644206:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545190912 00000100:00100000:3.0:1788869677.644302:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93 00000100:00100000:3.0:1788869677.644318:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+14:11284:x1875765545190912:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788869677.644439:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3271 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.644457:0:12967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc30b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa69 expref: 14 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.644467:0:12967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3271 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.644501:0:12967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc30b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa69 expref: 14 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.644514:0:12967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc30b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa69 expref: 14 pid: 9496 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869677.644527:0:12967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12967:1875765554709888:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869677.644608:0:12967:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8bdb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869677.655098:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869677.655504:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545191040 00000100:00100000:3.0:1788869677.655514:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545191040 00010000:00010000:3.0:1788869677.655555:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc30b1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa69 expref: 15 pid: 9496 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869677.655600:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:3.0:1788869677.655610:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89da9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+15:2387:x1875765545191040:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869677.655627:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869677.655635:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc30b1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa69 expref: 15 pid: 9496 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.655662:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc30b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa69 expref: 15 pid: 9496 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.655697:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:3.0:1788869677.655703:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3271 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.655714:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3271 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.655722:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3271 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.655746:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869677.655967:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89da9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+15:2387:x1875765545191040:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 358us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869677.655975:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 62 00010000:00010000:3.0:1788869677.656048:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb98e3400/0xbead52e175fc30b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa69 expref: 14 pid: 9496 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869677.656062:0:12967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12967:1875765554709888:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869677.656079:0:12967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3271 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.656086:0:12967:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3271 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.656092:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3271 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.658033:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3278 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.658053:0:12967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3232 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaacb expref: 14 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.658060:0:12967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3278 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.658094:0:12967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3232 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaacb expref: 14 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.658104:0:12967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3232 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaacb expref: 14 pid: 9496 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869677.658115:0:12967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12967:1875765554710016:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869677.658192:0:12967:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8bdba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869677.664478:0:12967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12967:1875765554710016:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869677.664510:0:12967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3278 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869677.673082:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869677.673133:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869677.673160:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545191296 00000100:00100000:1.0:1788869677.673169:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545191296 00000100:00100000:1.0:1788869677.673240:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 380 00000100:00100000:1.0:1788869677.673266:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8d0e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2387:x1875765545191296:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869677.673333:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8d0e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2387:x1875765545191296:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 84us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869677.673341:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 380 00000100:00100000:1.0:1788869677.673414:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869677.673529:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869677.673550:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869677.673572:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869677.673591:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545191808 00000100:00100000:1.0:1788869677.673594:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545191808 00000100:00100000:1.0:1788869677.673626:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545191424 00000100:00100000:1.0:1788869677.673628:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545191424 00000100:00100000:1.0:1788869677.673643:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545191680 00000100:00100000:1.0:1788869677.673645:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545191680 00000100:00100000:1.0:1788869677.673661:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 289 00000100:00100000:1.0:1788869677.673667:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545191808:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869677.673714:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545191808:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 47us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869677.673722:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 289 00000100:00100000:1.0:1788869677.673734:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 290 00000100:00100000:1.0:1788869677.673740:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545191424:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869677.673762:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545191424:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869677.673790:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 290 00000100:00100000:1.0:1788869677.673804:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 291 00000100:00100000:1.0:1788869677.673810:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545191680:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869677.673837:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545191680:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869677.673843:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 291 00000100:00100000:2.0:1788869677.674027:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545191168 00000100:00100000:2.0:1788869677.674032:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545191168 00010000:00010000:2.0:1788869677.674059:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3232 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaacb expref: 15 pid: 9496 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869677.674096:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:2.0:1788869677.674103:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+15:2387:x1875765545191168:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869677.674114:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869677.674120:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3232 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaacb expref: 15 pid: 9496 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.674133:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3232 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaacb expref: 15 pid: 9496 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.674164:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3232 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaacb expref: 15 pid: 9496 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.674182:0:9488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99fe831e3600) 00010000:00010000:2.0:1788869677.674188:0:9488:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3278 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.674197:0:9488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3278 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.674205:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3278 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.674233:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869677.674280:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+14:2387:x1875765545191168:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 176us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869677.674287:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:3.0:1788869677.677350:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545191552 00000100:00100000:3.0:1788869677.677365:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545191552 00000100:00100000:3.0:1788869677.677454:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 115 00000100:00100000:3.0:1788869677.677464:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+7:2387:x1875765545191552:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869677.677553:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+7:2387:x1875765545191552:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 91us (4139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869677.677575:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 115 00010000:00010000:3.0:1788869677.677605:0:12967:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3278 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.677616:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3278 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788869677.677740:0:12967:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1788869677.677856:0:12967:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1788869677.677893:0:12967:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1788869677.677976:0:12967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12967:1875765554710144:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788869677.678031:0:12967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869677.678065:0:12967:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8bdbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869677.678083:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554710144 00000100:00100000:3.0:1788869677.678087:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554710144 00000100:00100000:3.0:1788869677.678117:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788869677.678124:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12967:x1875765554710144:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788869677.678192:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12967:x1875765554710144:12345-0@lo:1000:mdt00_004.0 Request processed in 67us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869677.678199:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788869677.678235:0:12967:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788869677.678240:0:12967:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ff84f01880, transno 4294967304 00000100:00100000:3.0:1788869677.678272:0:12967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12967:1875765554710144:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1788869677.678381:0:12967:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1788869677.678434:0:12967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12967:1875765554710272:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788869677.678458:0:12967:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869677.678476:0:12967:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8bdb900 going to sleep for 11 seconds 00000100:00100000:3.0:1788869677.678553:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554710272 00000100:00100000:3.0:1788869677.678557:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554710272 00000100:00100000:3.0:1788869677.678579:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788869677.678585:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:12967:x1875765554710272:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788869677.678680:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:12967:x1875765554710272:12345-0@lo:1000:mdt00_004.0 Request processed in 95us (220us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788869677.678688:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788869677.678717:0:12967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12967:1875765554710272:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1788869677.678744:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3278 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.678752:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3278 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.678760:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3278 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.678767:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9f600 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869677.678771:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3278 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.678779:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3278 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.678795:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99fe831e3600) 00010000:00010000:3.0:1788869677.678799:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788869677.678803:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3278 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.678810:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3278 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.678844:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc31ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.678850:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc31ad lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.678857:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc31ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.678862:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a9000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869677.678865:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc31ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.678872:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc31ad lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.678880:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:3.0:1788869677.678883:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788869677.678886:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc31ad lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.678892:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc31ad lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.678913:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc327f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.678926:0:12967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc31c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaaf expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.678935:0:12967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc327f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.678963:0:12967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc31c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaaf expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869677.678976:0:12967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc31c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaaf expref: 17 pid: 6484 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869677.678987:0:12967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff88013100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12967:1875765554710400:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869677.679041:0:12967:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff927e26c0 going to sleep for 11 seconds 00000100:00080000:1.0:1788869677.687791:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869677.687803:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869677.687806:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869677.688243:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869677.688298:0:9487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545191936 00000100:00100000:2.0:1788869677.688306:0:9487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545191936 00010000:00010000:2.0:1788869677.688346:0:9487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc31c9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaaf expref: 18 pid: 6484 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869677.688380:0:9487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:2.0:1788869677.688388:0:9487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4fff62-1855-4361-a244-1a23eb291d37+18:2387:x1875765545191936:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869677.688414:0:9487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869677.688421:0:9487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc31c9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaaf expref: 18 pid: 6484 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.688442:0:9487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc31c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaaf expref: 18 pid: 6484 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.688465:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:2.0:1788869677.688470:0:9487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc327f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.688479:0:9487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc327f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.688487:0:9487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc327f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.688505:0:9487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869677.688553:0:9487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4fff62-1855-4361-a244-1a23eb291d37+18:2387:x1875765545191936:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 165us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869677.688560:0:9487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 64 00010000:00010000:1.0:1788869677.689303:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc31c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaaf expref: 17 pid: 6484 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869677.689321:0:12967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff88013100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12967:1875765554710400:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788869677.689345:0:12967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc327f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.689353:0:12967:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc327f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.689358:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc327f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.689370:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc327f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.689387:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc327f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.689417:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc327f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.689422:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9f400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869677.689426:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc327f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.689434:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc327f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.689445:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:1.0:1788869677.689448:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869677.689452:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc327f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.689458:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc327f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.689469:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3271 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.689476:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3271 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.689481:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3271 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.689487:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fc00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869677.689490:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3271 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.689506:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3271 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.689516:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99fe820c1700) 00010000:00010000:1.0:1788869677.689518:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788869677.689521:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3271 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869677.689526:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3271 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869677.689671:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+16:11284:x1875765545190912:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 45360us (47615us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788869677.689680:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93 00000020:00080000:1.0:1788869677.689866:0:12967:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788869677.690740:0:13761:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869677.690746:0:13761:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869677.690764:0:13761:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788869677.690780:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788869677.702014:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869677.702056:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545192192 00000100:00100000:2.0:1788869677.702066:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545192192 00000100:00100000:2.0:1788869677.702124:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:2.0:1788869677.702134:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+16:11284:x1875765545192192:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788869677.702459:0:6488:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788869677.702511:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:2.0:1788869677.702547:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3286 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.702567:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3286 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.702579:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3286 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.702587:0:6488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3286 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.702594:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3286 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.702601:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3286 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.702621:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788869677.702706:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+18:11284:x1875765545192192:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 573us (703us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788869677.702714:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000020:00080000:2.0:1788869677.702720:0:6488:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788869677.702744:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869677.702750:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3286 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.702757:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1c00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869677.702761:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3286 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.702780:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3286 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.702793:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99fe831e3600) 00010000:00010000:2.0:1788869677.702796:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788869677.702801:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3286 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.702807:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3286 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869677.702820:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869677.702822:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869677.702824:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869677.976572:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84f03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554710528:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869677.976646:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869677.976910:0:13961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554710528 00000100:00100000:3.0:1788869677.976918:0:13961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554710528 00000100:00100000:3.0:1788869677.976985:0:13961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788869677.976996:0:13961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554710528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869677.977020:0:13961:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1788869677.977069:0:13961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554710528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869677.977075:0:13961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788869677.977344:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84f01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554710656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869677.977377:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869677.977461:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554710656 00000100:00100000:1.0:1788869677.977466:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554710656 00000100:00100000:1.0:1788869677.977500:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788869677.977507:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1875765554710656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869677.977519:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1788869677.977555:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1875765554710656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869677.977561:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788869677.977601:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84f01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554710656:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788869677.977814:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869677.977847:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84f03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554710528:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788869678.107321:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869678.238645:0:14171:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869678.238653:0:14171:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869678.238673:0:14171:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788869678.238679:0:14171:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788869678.416554:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869678.416797:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545192448 00000100:00100000:0.0:1788869678.416808:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545192448 00000100:00100000:0.0:1788869678.416905:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94 00000100:00100000:0.0:1788869678.417037:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+18:11295:x1875765545192448:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1788869678.417065:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869678.417085:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc328d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaae7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.417206:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05a00/0xbead52e175fc3294 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.417221:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05a00/0xbead52e175fc3294 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.417231:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05a00/0xbead52e175fc3294 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869678.417242:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788869678.417366:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc328d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaae7 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.417383:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05a00/0xbead52e175fc3294 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaae7 expref: 20 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.417392:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:0.0:1788869678.417395:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788869678.417398:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb05a00, rc 0) 00000100:00100000:0.0:1788869678.419896:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+20:11295:x1875765545192448:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 2973us (3340us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788869678.419908:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94 00000100:00100000:2.0:1788869678.455051:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869678.455089:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545192576 00000100:00100000:2.0:1788869678.455099:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545192576 00000100:00100000:2.0:1788869678.455156:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 95 00000100:00100000:2.0:1788869678.455166:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+20:11295:x1875765545192576:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:2.0:1788869678.455281:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc32a2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455316:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc32a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455330:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc32a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455348:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc32a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455356:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc32a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455363:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc32a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455450:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc32b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455459:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc32b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455467:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc32b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869678.455516:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc32b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455530:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc32a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455536:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc32a2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455552:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc32a2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455559:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1c00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869678.455563:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc32a2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455569:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc32a2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455582:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:2.0:1788869678.455585:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869678.455589:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc32a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455596:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc32a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455609:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc32a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455614:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc32a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455619:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc32a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455624:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869678.455627:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc32a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455642:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc32a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455651:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99ffb89e1700) 00010000:00010000:2.0:1788869678.455653:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869678.455656:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc32a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455661:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc32a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455674:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc32b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455680:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc32b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455686:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc32b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455691:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869678.455694:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc32b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455700:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc32b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455706:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99ffb89e1000) 00010000:00010000:2.0:1788869678.455708:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869678.455711:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc32b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.455725:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc32b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869678.455798:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+20:11295:x1875765545192576:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 632us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869678.455806:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 95 00000100:00100000:3.0:1788869678.490181:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff84f01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554710784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869678.490280:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869678.490434:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554710784 00000100:00100000:1.0:1788869678.490443:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554710784 00000100:00100000:1.0:1788869678.490502:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788869678.490512:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554710784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788869678.490561:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788869678.490615:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554710784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869678.490622:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788869678.490716:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff84f01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554710784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869678.506077:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869678.506159:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545192832 00000100:00100000:3.0:1788869678.506172:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545192832 00000100:00100000:3.0:1788869678.506268:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 96 00000100:00100000:3.0:1788869678.506281:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+20:11298:x1875765545192832:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869678.506301:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869678.506336:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc32b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaaee expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506441:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc32be lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506457:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc32be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506469:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc32be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506483:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc32c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506490:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc32c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506497:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc32c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506612:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc32cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506621:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc32cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506628:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc32cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869678.506639:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788869678.506734:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc32be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506751:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc32be lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506758:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc32be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506764:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fe00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869678.506768:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc32be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506776:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc32be lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506789:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:3.0:1788869678.506792:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869678.506797:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc32be lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506803:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc32be lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506814:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc32c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506820:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc32c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506826:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc32c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506831:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9ee00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869678.506840:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc32c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506847:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc32c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506855:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99ff88bbff00) 00010000:00010000:3.0:1788869678.506858:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869678.506860:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc32c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506866:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc32c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506918:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc32b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaee expref: 23 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506945:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc32cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaee expref: 22 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.506953:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99ff88bbf200) 00010000:00010000:3.0:1788869678.506955:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869678.506958:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9fc00, rc 0) 00000100:00100000:3.0:1788869678.507034:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+22:11298:x1875765545192832:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 754us (965us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788869678.507041:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 96 00000100:00100000:2.0:1788869678.516062:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869678.516180:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545192960 00000100:00100000:0.0:1788869678.516190:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545192960 00000100:00100000:0.0:1788869678.516293:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 97 00000100:00100000:0.0:1788869678.516306:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+22:11298:x1875765545192960:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:0.0:1788869678.516384:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc32da lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.516418:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc32da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.516431:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc32da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.516469:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc32da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.516477:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc32da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.516484:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc32da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.516489:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869678.516494:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc32da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.516502:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc32da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.516514:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99ff88bbf200) 00010000:00010000:0.0:1788869678.516517:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788869678.516522:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc32da lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.516528:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc32da lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869678.516599:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+22:11298:x1875765545192960:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 296us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869678.516612:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 97 00000100:00100000:2.0:1788869678.521061:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869678.521152:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545193216 00000100:00100000:0.0:1788869678.521161:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545193216 00000100:00100000:0.0:1788869678.521220:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:0.0:1788869678.521231:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae5ba850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+22:11298:x1875765545193216:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1788869678.521511:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae5ba850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+23:11298:x1875765545193216:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 282us (460us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1788869678.521519:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:1.0:1788869678.582060:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869678.582167:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545193472 00000100:00100000:2.0:1788869678.582177:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545193472 00000100:00100000:2.0:1788869678.582249:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 98 00000100:00100000:2.0:1788869678.582298:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+23:10824:x1875765545193472:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1788869678.582325:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869678.582346:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc32e1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaaf5 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.582476:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc32e8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.582493:0:9496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc32cc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaee expref: 24 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.582502:0:9496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc32e8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.582543:0:9496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc32cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaee expref: 24 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.582578:0:9496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc32cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaee expref: 24 pid: 12967 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869678.582593:0:9496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff832e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9496:1875765554710912:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788869678.582689:0:9496:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae696780 going to sleep for 11 seconds 00000100:00100000:1.0:1788869678.587420:0:9496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff832e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9496:1875765554710912:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788869678.587451:0:9496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc32e8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869678.588778:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869678.588835:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545193600 00000100:00100000:3.0:1788869678.588844:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545193600 00010000:00010000:3.0:1788869678.588887:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc32cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaee expref: 25 pid: 12967 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869678.589416:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:3.0:1788869678.589431:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+25:2387:x1875765545193600:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869678.589448:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869678.589458:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc32cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaee expref: 25 pid: 12967 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.589472:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc32cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaee expref: 25 pid: 12967 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.589496:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc32cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaee expref: 25 pid: 12967 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.589521:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99ff88bbf200) 00010000:00010000:3.0:1788869678.589527:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc32e8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.589538:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc32e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.589545:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc32e8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.589630:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869678.589702:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+24:2387:x1875765545193600:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 275us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869678.589710:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 65 00010000:00010000:1.0:1788869678.589831:0:9496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc32e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869678.589841:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc32e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869678.589865:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788869678.590029:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc32e1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaf5 expref: 25 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869678.590049:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc32e8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaf5 expref: 24 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869678.590057:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99ff88bbf200) 00010000:00010000:1.0:1788869678.590060:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788869678.590063:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0000, rc 0) 00000100:00100000:1.0:1788869678.590093:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+24:10824:x1875765545193472:12345-192.168.201.30@tcp:101:bash.0 Request processed in 7798us (8043us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1788869678.590113:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 98 00000100:00100000:0.0:1788869678.592540:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869678.592590:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545193728 00000100:00100000:3.0:1788869678.592607:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545193728 00000100:00100000:3.0:1788869678.592668:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 99 00000100:00100000:3.0:1788869678.592681:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+24:10824:x1875765545193728:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1788869678.592707:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869678.592729:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc32f6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaafc expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.592769:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc32fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.592784:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc32fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.592795:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc32fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.592901:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc32f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaafc expref: 26 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.592919:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc32fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaafc expref: 25 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.592928:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99ff88bbf200) 00010000:00010000:3.0:1788869678.592931:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788869678.592934:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9ee00, rc 0) 00000100:00100000:3.0:1788869678.592995:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+25:10824:x1875765545193728:12345-192.168.201.30@tcp:101:bash.0 Request processed in 317us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869678.593002:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 99 00000100:00100000:2.0:1788869678.597115:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869678.597249:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545193984 00000100:00100000:0.0:1788869678.597299:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545193984 00000100:00100000:0.0:1788869678.597415:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 100 00000100:00100000:0.0:1788869678.597426:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+25:10824:x1875765545193984:12345-192.168.201.30@tcp:36:bash.0 00010000:00010000:0.0:1788869678.597664:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3304 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.597682:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3304 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.597694:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3304 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869678.597741:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1788869678.597766:0:6484:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000009e8ffee reply state 00000000e8de1140 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3304 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.597790:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3304 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.597820:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99ff88bbf200) 00010000:00010000:0.0:1788869678.597823:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869678.597827:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788869678.597868:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1788869678.597968:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+29:10824:x1875765545193984:12345-192.168.201.30@tcp:36:bash.0 Request processed in 543us (863us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788869678.597976:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 100 00000020:00080000:0.0:1788869678.597981:0:6484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788869678.600379:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869678.605324:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545194112 00000100:00100000:2.0:1788869678.605343:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545194112 00000100:00100000:2.0:1788869678.605606:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 101 00000100:00100000:2.0:1788869678.605619:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+29:10824:x1875765545194112:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1788869678.605650:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869678.605677:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc330b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaab03 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.605749:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc330b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab03 expref: 30 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.605766:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc330b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab03 expref: 30 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.605864:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99ff88bbf200) 00010000:00010000:2.0:1788869678.605868:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788869678.605871:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0a00, rc 0) 00000100:00100000:2.0:1788869678.605945:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+30:10824:x1875765545194112:12345-192.168.201.30@tcp:101:bash.0 Request processed in 327us (5576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869678.605972:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 101 00000100:00100000:1.0:1788869678.610524:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869678.612394:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545194240 00000100:00100000:3.0:1788869678.612438:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545194240 00000100:00100000:3.0:1788869678.612527:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:3.0:1788869678.612540:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf4fff62-1855-4361-a244-1a23eb291d37+6:10824:x1875765545194240:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1788869678.612611:0:8527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869678.612633:0:8527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025452db7/0xbead52e175fc3312 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaab0a expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869678.612663:0:8527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ffc2d, atime: 0x6a9ffc2b, ctime: 0x6a9ffc2d, blocks: 0x8 00010000:00010000:3.0:1788869678.612690:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=296s v=(0 0) 00010000:00010000:3.0:1788869678.612695:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869678.612706:0:8527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025452db7/0xbead52e175fc3312 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab0a expref: 7 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.612727:0:8527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000025452db7/0xbead52e175fc3312 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab0a expref: 7 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.612742:0:8527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9f600, rc 0) 00000100:00100000:3.0:1788869678.612874:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf4fff62-1855-4361-a244-1a23eb291d37+7:10824:x1875765545194240:12345-192.168.201.30@tcp:101:bash.0 Request processed in 335us (2357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869678.612883:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:2.0:1788869678.615988:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869678.616107:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545194368 00000100:00100000:3.0:1788869678.616119:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545194368 00002000:00010000:3.0:1788869678.616168:0:8404:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1788869678.616173:0:8404:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ff832e0a80 with x1875765545194368 ext(0->18446744073709551615) 00002000:00010000:3.0:1788869678.616187:0:8404:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ff832e0a80. 00000100:00100000:3.0:1788869678.616368:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:3.0:1788869678.616466:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf4fff62-1855-4361-a244-1a23eb291d37+7:2388:x1875765545194368:12345-192.168.201.30@tcp:10:bash.0 00002000:00010000:3.0:1788869678.616888:0:8404:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788869678.616893:0:8404:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788869677 -> 1788869679 00002000:00010000:3.0:1788869678.616895:0:8404:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1788869675 -> 1788869675 00002000:00010000:3.0:1788869678.616897:0:8404:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788869677 -> 1788869679 00002000:00010000:3.0:1788869678.616899:0:8404:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1788869678.617032:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf4fff62-1855-4361-a244-1a23eb291d37+8:2388:x1875765545194368:12345-192.168.201.30@tcp:10:bash.0 Request processed in 653us (1058us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788869678.617041:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00002000:00010000:3.0:1788869678.617045:0:8404:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1788869678.617048:0:8404:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ff832e0a80 with x1875765545194368 ext(0->18446744073709551615) 00002000:00010000:3.0:1788869678.617053:0:8404:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ff832e0a80. 00000100:00100000:1.0:1788869678.693730:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869678.693794:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545194496 00000100:00100000:3.0:1788869678.693803:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545194496 00000100:00100000:3.0:1788869678.693855:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 102 00000100:00100000:3.0:1788869678.693866:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+30:11312:x1875765545194496:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:3.0:1788869678.693944:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3319 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.693961:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3319 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.693974:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3319 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.693991:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3320 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.693998:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3320 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694018:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3320 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694150:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3327 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694209:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3327 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694216:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3327 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869678.694289:0:12967:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3327 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694298:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3319 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694302:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3319 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694306:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3319 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694310:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fc00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869678.694313:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3319 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694317:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3319 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694325:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:3.0:1788869678.694332:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869678.694336:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3319 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694340:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3319 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694349:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3320 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694353:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3320 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694357:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3320 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694359:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fe00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869678.694361:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3320 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694364:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3320 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694368:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99ff88bbf900) 00010000:00010000:3.0:1788869678.694369:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869678.694371:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3320 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694374:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3320 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694390:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3327 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694400:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3327 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694417:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3327 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694422:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9f400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869678.694425:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3327 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694431:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3327 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694439:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99ff88bbf200) 00010000:00010000:3.0:1788869678.694442:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869678.694445:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3327 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.694451:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3327 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869678.694520:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+30:11312:x1875765545194496:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 657us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869678.694526:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 102 00000100:00100000:1.0:1788869678.738876:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869678.739340:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545194752 00000100:00100000:2.0:1788869678.739353:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545194752 00000100:00100000:2.0:1788869678.739427:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 103 00000100:00100000:2.0:1788869678.739437:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+30:11315:x1875765545194752:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1788869678.739459:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869678.739480:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1200/0xbead52e175fc332e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaab11 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.739583:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3335 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.739598:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3335 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.739609:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3335 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.739627:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc333c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.739634:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc333c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.739640:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc333c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.739740:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc3343 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.739768:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc3343 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.739775:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc3343 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869678.739786:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788869678.739862:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3335 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.739870:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3335 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.739877:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3335 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.739883:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869678.739888:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3335 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.739896:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3335 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.739908:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:2.0:1788869678.739911:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869678.739917:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3335 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.739924:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3335 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.739937:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc333c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.739950:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc333c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.739956:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc333c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.739962:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869678.739965:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc333c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.739970:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc333c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.739978:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99ffb89e1000) 00010000:00010000:2.0:1788869678.739981:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869678.739983:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc333c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.739990:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc333c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.740031:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1200/0xbead52e175fc332e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab11 expref: 33 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.740044:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc3343 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab11 expref: 32 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869678.740051:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99ff88bbf200) 00010000:00010000:2.0:1788869678.740054:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788869678.740062:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1a00, rc 0) 00000100:00100000:2.0:1788869678.740135:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+32:11315:x1875765545194752:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 699us (1267us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788869678.740143:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 103 00000100:00100000:2.0:1788869678.748717:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869678.750874:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545194880 00000100:00100000:0.0:1788869678.751085:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545194880 00000100:00100000:0.0:1788869678.751170:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 104 00000100:00100000:0.0:1788869678.751181:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+32:11315:x1875765545194880:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:0.0:1788869678.751295:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc3351 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.751312:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc32e8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaf5 expref: 32 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.751322:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc3351 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.751359:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc32e8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaf5 expref: 32 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.751373:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc32e8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaf5 expref: 32 pid: 9496 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869678.751387:0:6484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6484:1875765554711040:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788869678.751589:0:6484:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869678.760410:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869678.760486:0:6484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6484:1875765554711040:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788869678.760516:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc3351 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869678.760561:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545195136 00000100:00100000:2.0:1788869678.760570:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545195136 00000100:00100000:2.0:1788869678.760657:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:2.0:1788869678.760665:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+33:6152:x1875765545195136:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788869678.760929:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+34:6152:x1875765545195136:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 259us (531us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788869678.760935:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:3.0:1788869678.763345:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869678.763459:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545195264 00000100:00100000:0.0:1788869678.763470:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545195264 00010000:00010000:0.0:1788869678.763511:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc32e8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaf5 expref: 34 pid: 9496 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869678.763671:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:0.0:1788869678.763683:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88011f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+34:2388:x1875765545195264:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869678.763701:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869678.763708:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc32e8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaf5 expref: 34 pid: 9496 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.763721:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc32e8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaf5 expref: 34 pid: 9496 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.763744:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc32e8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaaf5 expref: 34 pid: 9496 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.763762:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99ff88bbf200) 00010000:00010000:0.0:1788869678.763768:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc3351 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.763791:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc3351 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.763818:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc3351 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.763854:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869678.763885:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc3351 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869678.763894:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc3351 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869678.763905:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88011f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+33:2388:x1875765545195264:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 224us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869678.763914:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 66 00010000:00010000:1.0:1788869678.764070:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc3351 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869678.764076:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc3351 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869678.764081:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc3351 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869678.764085:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869678.764088:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc3351 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869678.764092:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc3351 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869678.764099:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99ff88bbf200) 00010000:00010000:1.0:1788869678.764101:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869678.764109:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc3351 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869678.764113:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc3351 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869678.764146:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+32:11315:x1875765545194880:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 12967us (15440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869678.764151:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 104 00000100:00100000:2.0:1788869678.774147:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869678.774211:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545195520 00000100:00100000:1.0:1788869678.774221:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545195520 00000100:00100000:1.0:1788869678.774297:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:1.0:1788869678.774305:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+32:11315:x1875765545195520:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:1.0:1788869678.774561:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+33:11315:x1875765545195520:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 255us (419us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788869678.774570:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:2.0:1788869678.910314:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869678.910445:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545195776 00000100:00100000:3.0:1788869678.910456:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545195776 00000100:00100000:3.0:1788869678.910523:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 105 00000100:00100000:3.0:1788869678.910534:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+33:11326:x1875765545195776:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:3.0:1788869678.910576:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869678.910598:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3358 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaab18 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.910686:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc335f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.910702:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc335f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.910713:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc335f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.910729:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3366 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.910736:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3366 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.910741:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3366 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.910857:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc336d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.910867:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc336d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.910873:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc336d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869678.910883:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788869678.910965:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc335f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.910973:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc335f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.910979:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc335f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.910984:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fe00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869678.910988:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc335f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.910995:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc335f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.911008:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:3.0:1788869678.911012:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869678.911016:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc335f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.911023:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc335f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.911036:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3366 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.911042:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3366 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.911048:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3366 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.911065:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fc00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869678.911068:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3366 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.911074:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3366 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.911082:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99ff88bbf900) 00010000:00010000:3.0:1788869678.911084:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869678.911087:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3366 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.911092:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3366 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.911143:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3358 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab18 expref: 36 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.911157:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc336d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab18 expref: 35 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.911164:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99ff88bbf200) 00010000:00010000:3.0:1788869678.911167:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869678.911169:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534a00, rc 0) 00000100:00100000:3.0:1788869678.911300:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+35:11326:x1875765545195776:12345-192.168.201.30@tcp:101:cat.0 Request processed in 722us (949us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788869678.911308:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 105 00000100:00100000:3.0:1788869678.919766:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869678.921581:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545196032 00000100:00100000:1.0:1788869678.921596:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545196032 00000100:00100000:1.0:1788869678.921794:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:1.0:1788869678.921808:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+35:11326:x1875765545196032:12345-192.168.201.30@tcp:35:cat.0 00000100:00100000:1.0:1788869678.922150:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+36:11326:x1875765545196032:12345-192.168.201.30@tcp:35:cat.0 Request processed in 344us (2392us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788869678.922158:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:0.0:1788869678.947447:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869678.948247:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545196288 00000100:00100000:3.0:1788869678.948284:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545196288 00000100:00100000:3.0:1788869678.948345:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 106 00000100:00100000:3.0:1788869678.948355:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+36:11327:x1875765545196288:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1788869678.948437:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788869678.948467:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc330b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab03 expref: 36 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.948493:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc336d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab18 expref: 35 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.948507:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc3343 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab11 expref: 34 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.948520:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc32fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaafc expref: 33 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.948530:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99ff88bbf200) 00010000:00010000:3.0:1788869678.948535:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869678.949000:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc337b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.949016:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc337b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.949028:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc337b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.949047:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc3382 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.949068:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc3382 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.949076:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc3382 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.949288:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3389 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.949298:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3389 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.949305:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3389 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788869678.949771:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1788869678.949782:0:9496:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 296876528101ns, next at 297876525498ns, rc = 0 00010000:00010000:3.0:1788869678.949833:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3390 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.949843:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3390 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.949851:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3390 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.949859:0:9496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3390 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.949865:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3390 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.949883:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3390 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.951158:0:9496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869678.951193:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3389 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.951466:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3389 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.951473:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3389 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.951480:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869678.951485:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3389 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.951492:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3389 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.951508:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99ff88bbf200) 00010000:00010000:3.0:1788869678.951512:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788869678.951516:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3389 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.951523:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3389 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.951547:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc337b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.952056:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc337b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.952085:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc337b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.952091:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534600 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869678.952094:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc337b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.952099:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc337b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.952108:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:3.0:1788869678.952111:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869678.952114:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc337b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.952120:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc337b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869678.952137:0:9496:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009d3575b7 reply state 000000003eb8abf4 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc3382 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.952158:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc3382 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869678.952165:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99ff88bbf900) 00010000:00010000:3.0:1788869678.952167:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788869678.952170:0:9496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788869678.952553:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+34:11327:x1875765545196288:12345-192.168.201.30@tcp:36:rm.0 Request processed in 4195us (5111us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788869678.953011:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 106 00010000:00010000:0.0:1788869678.960212:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869678.960228:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3390 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.960240:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535400 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869678.960244:0:7425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3390 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.960270:0:7425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3390 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.960292:0:7425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99ff88bbf200) 00010000:00010000:0.0:1788869678.960295:0:7425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788869678.960300:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3390 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.960306:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3390 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869678.960327:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869678.960329:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869678.960331:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869679.033710:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869679.033820:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545196544 00000100:00100000:1.0:1788869679.033831:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545196544 00000100:00100000:1.0:1788869679.033917:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 107 00000100:00100000:1.0:1788869679.033930:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+34:11333:x1875765545196544:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:1.0:1788869679.033973:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869679.033997:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3397 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaab1f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788869679.034063:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788869679.034124:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc339e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.034139:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc339e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.034150:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc339e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.034161:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc33a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.034168:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc33a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.034175:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc33a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788869679.034897:0:6484:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788869679.035065:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc33ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.035078:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc33ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.035086:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc33ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.035142:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc339e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.035150:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc339e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.035156:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc339e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.035162:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869679.035166:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc339e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.035174:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc339e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.035185:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:1.0:1788869679.035188:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869679.035193:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc339e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.035200:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc339e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788869679.035214:0:6484:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f851f666 reply state 0000000051c25b7f transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc33a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.035226:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc33a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.035232:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99ff88bbf900) 00010000:00010000:1.0:1788869679.035240:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788869679.035244:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788869679.035657:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3397 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab1f expref: 37 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.035677:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc33ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab1f expref: 36 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.035684:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6100) 00010000:00010000:1.0:1788869679.035687:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869679.035690:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80030a00, rc 0) 00000100:00100000:1.0:1788869679.035809:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+37:11333:x1875765545196544:12345-192.168.201.30@tcp:101:bash.0 Request processed in 1881us (2110us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788869679.035818:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 107 00000100:00100000:2.0:1788869679.041386:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869679.041549:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545196672 00000100:00100000:3.0:1788869679.041560:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545196672 00000100:00100000:3.0:1788869679.041654:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:3.0:1788869679.041666:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+7:2387:x1875765545196672:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1788869679.041684:0:8400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869679.041704:0:8400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a3857aa/0xbead52e175fc33ba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaab26 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869679.041730:0:8400:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869679.041750:0:8400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=296s v=(0 0) 00010000:00010000:3.0:1788869679.041754:0:8400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869679.041764:0:8400:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a3857aa/0xbead52e175fc33ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab26 expref: 8 pid: 8400 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.041794:0:8400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008a3857aa/0xbead52e175fc33ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab26 expref: 8 pid: 8400 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.041808:0:8400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534600, rc 0) 00000100:00100000:3.0:1788869679.041871:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+8:2387:x1875765545196672:12345-192.168.201.30@tcp:101:bash.0 Request processed in 208us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.041878:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00080000:0.0:1788869679.041951:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869679.050648:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869679.050754:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545196800 00000100:00100000:2.0:1788869679.050764:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545196800 00000100:00100000:2.0:1788869679.050820:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:2.0:1788869679.050829:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+8:11333:x1875765545196800:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1788869679.050847:0:8399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869679.050865:0:8399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0f430df/0xbead52e175fc33c1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaab2d expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.050897:0:8399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008a3857aa/0xbead52e175fc33ba lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab26 expref: 9 pid: 8400 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.050907:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869679.050926:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869679.050932:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0f430df/0xbead52e175fc33c1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab2d expref: 9 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.050969:0:8399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008a3857aa/0xbead52e175fc33ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab26 expref: 9 pid: 8400 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.050984:0:8399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008a3857aa/0xbead52e175fc33ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab26 expref: 9 pid: 8400 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869679.050998:0:8399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff832e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8399:1875765554711168:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788869679.051475:0:8399:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae696b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869679.062537:0:8399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff832e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8399:1875765554711168:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788869679.062581:0:8399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c0f430df/0xbead52e175fc33c1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab2d expref: 9 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.062605:0:8399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1c00, rc 0) 00000100:00100000:2.0:1788869679.062697:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+9:11333:x1875765545196800:12345-192.168.201.30@tcp:101:bash.0 Request processed in 11867us (12058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869679.062706:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:0.0:1788869679.066174:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869679.073718:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545196928 00000100:00100000:3.0:1788869679.073735:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545196928 00010000:00010000:3.0:1788869679.073788:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008a3857aa/0xbead52e175fc33ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab26 expref: 9 pid: 8400 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869679.073924:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:3.0:1788869679.073934:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+9:2388:x1875765545196928:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869679.073950:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869679.073972:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008a3857aa/0xbead52e175fc33ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab26 expref: 9 pid: 8400 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.073985:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008a3857aa/0xbead52e175fc33ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab26 expref: 9 pid: 8400 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.074007:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a3857aa/0xbead52e175fc33ba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab26 expref: 9 pid: 8400 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.074023:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869679.074027:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869679.074036:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0f430df/0xbead52e175fc33c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab2d expref: 8 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.074048:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0f430df/0xbead52e175fc33c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab2d expref: 8 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.074085:0:6470:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c0f430df/0xbead52e175fc33c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab2d expref: 8 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869679.074109:0:6470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a30a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6470:1875765554711296:192.168.201.30@tcp:105: 00000100:00100000:3.0:1788869679.074207:0:6470:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84fad900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869679.090221:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869679.090361:0:6470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a30a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6470:1875765554711296:192.168.201.30@tcp:105: 00010000:00010000:3.0:1788869679.090383:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869679.090479:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+8:2388:x1875765545196928:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 16545us (24313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.090492:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:2.0:1788869679.091141:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545197184 00000100:00100000:2.0:1788869679.091150:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545197184 00000100:00100000:2.0:1788869679.091207:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:2.0:1788869679.091217:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+37:11333:x1875765545197184:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:2.0:1788869679.091556:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+38:11333:x1875765545197184:12345-192.168.201.30@tcp:35:bash.0 Request processed in 339us (1352us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788869679.091576:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 25 00010000:00010000:0.0:1788869679.132831:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869679.220186:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869679.220248:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869679.220633:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545197312 00000100:00100000:1.0:1788869679.220644:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545197312 00002000:00100000:1.0:1788869679.220705:0:8406:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff99ffbfb10000 x1875765545197312/t0(0) o4->bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp:625/0 lens 504/0 e 0 to 0 dl 1788869690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788869679.220719:0:8406:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffbfb10000 with x1875765545197312 ext(0->8) 00002000:00010000:1.0:1788869679.220725:0:8406:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffbfb10000 00000100:00100000:1.0:1788869679.220755:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:1.0:1788869679.220765:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf4fff62-1855-4361-a244-1a23eb291d37+8:2388:x1875765545197312:12345-192.168.201.30@tcp:4:bash.0 00000100:00100000:3.0:1788869679.221569:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545197440 00000100:00100000:3.0:1788869679.221578:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545197440 00000100:00100000:3.0:1788869679.221628:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:3.0:1788869679.221636:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+11:2388:x1875765545197440:12345-192.168.201.30@tcp:16:kworker.0 00000100:00100000:3.0:1788869679.222703:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf4fff62-1855-4361-a244-1a23eb291d37+11:2388:x1875765545197312:12345-192.168.201.30@tcp:4:bash.0 Request processed in 1933us (2521us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788869679.222715:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00002000:00100000:3.0:1788869679.222728:0:8406:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff99ffbfb10000 x1875765545197312/t4294967303(0) o4->bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp:625/0 lens 504/448 e 0 to 0 dl 1788869690 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788869679.222740:0:8406:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffbfb10000 with x1875765545197312 ext(0->8) 00002000:00010000:3.0:1788869679.222745:0:8406:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99ffbfb10000 00000001:00080000:2.0:1788869679.226666:0:9476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1788869679.226689:0:9476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1788869679.232607:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2388:x1875765545197440:12345-192.168.201.30@tcp:16:kworker.0 Request processed in 10958us (12345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.232623:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:0.0:1788869679.357309:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869679.357445:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545197568 00000100:00100000:2.0:1788869679.357461:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545197568 00000100:00100000:2.0:1788869679.357541:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 108 00000100:00100000:2.0:1788869679.357552:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+38:11349:x1875765545197568:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1788869679.357577:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869679.357598:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc33c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaab34 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.357668:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc33cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.357684:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc33cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.357695:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc33cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869679.357741:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788869679.357745:0:6486:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869679.357765:0:6486:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc33cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.357791:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc33c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab34 expref: 40 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.357812:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc33cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab34 expref: 39 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.357835:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:2.0:1788869679.357845:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869679.357849:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0800, rc 0) 00000100:00100000:2.0:1788869679.357936:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+39:11349:x1875765545197568:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 385us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869679.357943:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 108 00000100:00100000:1.0:1788869679.362245:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869679.362641:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545197824 00000100:00100000:3.0:1788869679.362655:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545197824 00000100:00100000:3.0:1788869679.362733:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 109 00000100:00100000:3.0:1788869679.362744:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+39:11349:x1875765545197824:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869679.362772:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869679.362815:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc33d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaab3b expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.362966:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc33dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.362982:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc33dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.362996:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc33dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869679.363010:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788869679.363145:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc33d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab3b expref: 42 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.363168:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc33dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab3b expref: 41 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.363178:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6100) 00010000:00010000:3.0:1788869679.363182:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869679.363186:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81535200, rc 0) 00000100:00100000:3.0:1788869679.363320:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+41:11349:x1875765545197824:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 577us (1091us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1788869679.363328:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 109 00000100:00100000:0.0:1788869679.366446:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869679.366593:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545198080 00000100:00100000:1.0:1788869679.366607:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545198080 00000100:00100000:1.0:1788869679.366686:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 110 00000100:00100000:1.0:1788869679.366698:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+41:11349:x1875765545198080:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1788869679.366749:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869679.366777:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc33eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaab42 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.366907:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc33f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.366924:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc33f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.366936:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc33f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869679.366951:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788869679.367075:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc33eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab42 expref: 44 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.367096:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc33f2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab42 expref: 43 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.367106:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6100) 00010000:00010000:1.0:1788869679.367110:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788869679.367113:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80031e00, rc 0) 00000100:00100000:1.0:1788869679.367193:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+43:11349:x1875765545198080:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 497us (759us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1788869679.367202:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 110 00000100:00100000:2.0:1788869679.373866:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869679.373913:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869679.374005:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545198208 00000100:00100000:3.0:1788869679.374019:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545198208 00000100:00100000:3.0:1788869679.374099:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:3.0:1788869679.374111:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+43:2388:x1875765545198208:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869679.374154:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869679.374189:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc33dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab3b expref: 43 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.374221:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6100) 00010000:00010000:3.0:1788869679.374227:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869679.374501:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+42:2388:x1875765545198208:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 390us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.374510:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:0.0:1788869679.374813:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545198336 00000100:00100000:0.0:1788869679.374818:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545198336 00000100:00100000:0.0:1788869679.374856:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:0.0:1788869679.374864:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf4fff62-1855-4361-a244-1a23eb291d37+6:2388:x1875765545198336:12345-192.168.201.30@tcp:1:lfs.0 00010000:00010000:0.0:1788869679.374906:0:8527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc3400 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.374937:0:8527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0f430df/0xbead52e175fc33c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab2d expref: 6 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.374947:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788869679.374951:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869679.374956:0:8527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc3400 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.374999:0:8527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c0f430df/0xbead52e175fc33c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab2d expref: 6 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.375031:0:8527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c0f430df/0xbead52e175fc33c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab2d expref: 6 pid: 8399 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869679.375049:0:8527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8527:1875765554711424:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788869679.375136:0:8527:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869679.381159:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869679.381307:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545198464 00000100:00100000:1.0:1788869679.381319:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545198464 00010000:00010000:1.0:1788869679.381371:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c0f430df/0xbead52e175fc33c1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab2d expref: 7 pid: 8399 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869679.381450:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:1.0:1788869679.381461:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89daa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+7:2387:x1875765545198464:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869679.381481:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788869679.381504:0:6469:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788869679.381507:0:6469:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788869679 00002000:00010000:1.0:1788869679.381510:0:6469:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788869679 00002000:00010000:1.0:1788869679.381512:0:6469:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788869679.381519:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c0f430df/0xbead52e175fc33c1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab2d expref: 7 pid: 8399 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.381536:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c0f430df/0xbead52e175fc33c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab2d expref: 7 pid: 8399 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.381573:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788869679.381579:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788869679.381585:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc3400 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.381596:0:6469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc3400 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.381623:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869679.381694:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89daa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+7:2387:x1875765545198464:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 234us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869679.381702:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 68 00010000:00010000:0.0:1788869679.381981:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0f430df/0xbead52e175fc33c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab2d expref: 6 pid: 8399 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869679.381999:0:8527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8527:1875765554711424:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788869679.382025:0:8527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc3400 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.382037:0:8527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc3400 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.382044:0:8527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc3400 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.382069:0:8527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc3400 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.382078:0:8527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc3400 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.382099:0:8527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc3400 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.382107:0:8527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05800 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869679.382111:0:8527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc3400 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.382120:0:8527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc3400 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.382134:0:8527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc3400 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.382142:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc3400 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869679.382209:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2388:x1875765545198336:12345-192.168.201.30@tcp:1:lfs.0 Request processed in 7345us (8294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869679.382218:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:2.0:1788869679.387036:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869679.387132:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545198720 00000100:00100000:0.0:1788869679.387145:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545198720 00000100:00100000:0.0:1788869679.387226:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:0.0:1788869679.387238:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae5bb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+42:11349:x1875765545198720:12345-192.168.201.30@tcp:35:lfs.0 00000004:00010000:0.0:1788869679.387337:0:6488:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc33f2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab42 expref: 42 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869679.387621:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1788869679.387660:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788869679.388075:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:0.0:1788869679.388119:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3407 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.388137:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc33ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab1f expref: 46 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.388147:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3407 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.388189:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc33ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab1f expref: 46 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.388205:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc33ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab1f expref: 46 pid: 6484 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869679.388223:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6488:1875765554711552:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788869679.388362:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869679.390895:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6488:1875765554711552:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788869679.390942:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3407 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869679.392580:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869679.392677:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545198848 00000100:00100000:3.0:1788869679.392689:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545198848 00010000:00010000:3.0:1788869679.392743:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc33ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab1f expref: 47 pid: 6484 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869679.392791:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:3.0:1788869679.392803:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+47:2387:x1875765545198848:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869679.392822:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869679.392829:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc33ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab1f expref: 47 pid: 6484 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.392844:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc33ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab1f expref: 47 pid: 6484 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.392871:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc33ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab1f expref: 47 pid: 6484 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.392914:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6100) 00010000:00010000:3.0:1788869679.392920:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3407 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.392943:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3407 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.392951:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3407 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.392987:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869679.393059:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+46:2387:x1875765545198848:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 257us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.393067:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 69 00010000:00010000:0.0:1788869679.393727:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3407 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.393737:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3407 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869679.393884:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1788869679.394037:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1788869679.394145:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6488:1875765554711680:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788869679.394227:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869679.394293:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869679.394493:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554711680 00000100:00100000:3.0:1788869679.394500:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554711680 00000100:00100000:3.0:1788869679.394557:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788869679.394565:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6488:x1875765554711680:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788869679.394663:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6488:x1875765554711680:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 98us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.394671:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:0.0:1788869679.395473:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869679.395515:0:6488:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:0.0:1788869679.395523:0:6488:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:0.0:1788869679.395545:0:6488:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ff8729b100, transno 4294967302 00000100:00100000:0.0:1788869679.395567:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6488:1875765554711680:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788869679.395712:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1788869679.395774:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6488:1875765554711808:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788869679.395818:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869679.395841:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43180 going to sleep for 11 seconds 00000100:00100000:1.0:1788869679.396059:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554711808 00000100:00100000:1.0:1788869679.396066:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554711808 00000100:00100000:1.0:1788869679.396111:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788869679.396120:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6488:x1875765554711808:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788869679.396314:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6488:x1875765554711808:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 194us (495us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788869679.396323:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788869679.396519:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6488:1875765554711808:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788869679.396562:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1788869679.396600:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3407 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.396610:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3407 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.396619:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3407 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.396626:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869679.396631:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3407 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.396654:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3407 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.396674:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6100) 00010000:00010000:0.0:1788869679.396677:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788869679.396682:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3407 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.396689:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3407 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788869679.396792:0:6488:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788869679.396854:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1788869679.396867:0:6488:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 297323613581ns, next at 298323610674ns, rc = 0 00000001:00080000:0.0:1788869679.396873:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:0.0:1788869679.396895:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6100) 00010000:00010000:0.0:1788869679.396897:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788869679.396905:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc33f2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab42 expref: 50 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869679.397030:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae5bb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+49:11349:x1875765545198720:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 9795us (10009us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788869679.397038:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 26 00000020:00080000:0.0:1788869679.397042:0:6488:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788869679.405043:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869679.405511:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545198976 00000100:00100000:1.0:1788869679.405524:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545198976 00000100:00100000:1.0:1788869679.405647:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 111 00000100:00100000:1.0:1788869679.405659:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+49:11349:x1875765545198976:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1788869679.405694:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869679.405726:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc340e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaab49 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.405800:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc340e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab49 expref: 50 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.405819:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc340e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab49 expref: 50 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.405842:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:1.0:1788869679.405846:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869679.405850:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80031400, rc 0) 00000100:00100000:1.0:1788869679.405940:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+50:11349:x1875765545198976:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 283us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869679.405949:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 111 00000100:00100000:3.0:1788869679.408951:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869679.409050:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545199232 00000100:00100000:0.0:1788869679.409062:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545199232 00000100:00100000:0.0:1788869679.409133:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:0.0:1788869679.409145:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+50:11349:x1875765545199232:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1788869679.409505:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+51:11349:x1875765545199232:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 361us (578us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788869679.409513:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:2.0:1788869679.510229:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869679.510544:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545199360 00000100:00100000:1.0:1788869679.510558:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545199360 00000100:00100000:1.0:1788869679.510637:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 112 00000100:00100000:1.0:1788869679.510650:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+51:11359:x1875765545199360:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:1.0:1788869679.510754:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3415 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.510776:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3415 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.510791:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3415 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.510806:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc341c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.510814:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc341c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.510821:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc341c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.510914:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3423 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.510923:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3423 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.510930:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3423 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788869679.510989:0:12967:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3423 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.511023:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3415 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.511030:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3415 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.511037:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3415 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.511043:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869679.511048:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3415 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.511056:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3415 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.511070:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:1.0:1788869679.511073:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869679.511078:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3415 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.511086:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3415 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.511102:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc341c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.511109:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc341c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.511115:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc341c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.511127:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80030000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869679.511131:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc341c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.511137:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc341c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.511146:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99ff88bbf900) 00010000:00010000:1.0:1788869679.511148:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869679.511151:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc341c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.511157:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc341c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.511167:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3423 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.511173:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3423 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.511178:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3423 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.511183:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869679.511186:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3423 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.511192:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3423 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.511223:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:1.0:1788869679.511225:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869679.511228:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3423 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.511234:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3423 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869679.511950:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+51:11359:x1875765545199360:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 735us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869679.511963:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 112 00000100:00100000:3.0:1788869679.546211:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869679.546454:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545199616 00000100:00100000:2.0:1788869679.546469:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545199616 00000100:00100000:2.0:1788869679.546716:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 113 00000100:00100000:2.0:1788869679.546731:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+51:11362:x1875765545199616:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1788869679.546764:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869679.546805:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc342a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaab50 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.546917:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3431 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.547427:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3431 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.547443:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3431 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.547478:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3438 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.547488:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3438 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.547496:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3438 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.547637:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc343f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.547647:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc343f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.547654:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc343f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869679.547674:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788869679.547799:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3431 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.547807:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3431 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.547820:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3431 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.547828:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1c00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869679.547833:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3431 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.547859:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3431 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.547875:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:2.0:1788869679.547879:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869679.547885:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3431 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.547891:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3431 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.547909:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3438 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.547915:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3438 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.547921:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3438 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.548013:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869679.548017:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3438 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.548023:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3438 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.548033:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99ff88bbf900) 00010000:00010000:2.0:1788869679.548036:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869679.548039:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3438 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.548055:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3438 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.548101:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc342a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab50 expref: 54 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.548116:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc343f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab50 expref: 53 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.548125:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:2.0:1788869679.548127:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869679.548130:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1e00, rc 0) 00000100:00100000:2.0:1788869679.548353:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+53:11362:x1875765545199616:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1626us (2162us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788869679.548362:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 113 00000100:00100000:3.0:1788869679.551545:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869679.551638:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545199744 00000100:00100000:1.0:1788869679.551649:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545199744 00000100:00100000:1.0:1788869679.551741:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 114 00000100:00100000:1.0:1788869679.551752:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+53:11362:x1875765545199744:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:1.0:1788869679.551830:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc344d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.551850:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc344d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.551863:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc344d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.551901:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc344d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.551908:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc344d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.551948:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc344d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.551954:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80030000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869679.551959:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc344d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.551968:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc344d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.551982:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:1.0:1788869679.551986:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869679.551991:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc344d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.551998:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc344d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869679.552119:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+53:11362:x1875765545199744:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 368us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869679.552127:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 114 00000100:00100000:2.0:1788869679.554344:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869679.554673:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545200000 00000100:00100000:0.0:1788869679.554685:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545200000 00000100:00100000:0.0:1788869679.554776:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:0.0:1788869679.554788:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+53:11362:x1875765545200000:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1788869679.555074:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+54:11362:x1875765545200000:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 288us (739us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1788869679.555082:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:2.0:1788869679.601444:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869679.601563:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545200256 00000100:00100000:0.0:1788869679.601577:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545200256 00000100:00100000:0.0:1788869679.601659:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 115 00000100:00100000:0.0:1788869679.601672:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+54:11372:x1875765545200256:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1788869679.601707:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869679.601712:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788869679.601749:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc33cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab34 expref: 54 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.601774:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:0.0:1788869679.601782:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869679.601800:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3454 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaab57 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.601948:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc345b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.601986:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc343f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab50 expref: 54 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.601996:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc345b lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.602035:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc343f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab50 expref: 54 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.602049:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc343f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab50 expref: 54 pid: 6486 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869679.602064:0:6484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6484:1875765554711936:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788869679.602178:0:6484:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43540 going to sleep for 11 seconds 00000100:00100000:0.0:1788869679.604452:0:6484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6484:1875765554711936:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788869679.604494:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc345b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869679.606752:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869679.606905:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545200384 00000100:00100000:3.0:1788869679.606923:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545200384 00010000:00010000:3.0:1788869679.607295:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc343f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab50 expref: 55 pid: 6486 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869679.607439:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:3.0:1788869679.607451:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+55:2388:x1875765545200384:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869679.607472:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869679.607480:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc343f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab50 expref: 55 pid: 6486 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.607495:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc343f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab50 expref: 55 pid: 6486 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.607524:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc343f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab50 expref: 55 pid: 6486 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.607544:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:3.0:1788869679.607550:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc345b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.607561:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc345b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.607571:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc345b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.607598:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869679.607674:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+54:2388:x1875765545200384:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 224us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.607682:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 70 00010000:00010000:0.0:1788869679.607952:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc345b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.607962:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc345b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869679.607986:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788869679.608165:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3454 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab57 expref: 55 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.608203:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc345b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab57 expref: 54 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.608212:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:0.0:1788869679.608215:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788869679.608218:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04c00, rc 0) 00000100:00100000:0.0:1788869679.608307:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+54:11372:x1875765545200256:12345-192.168.201.30@tcp:101:bash.0 Request processed in 6636us (6878us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788869679.608315:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 115 00000100:00100000:2.0:1788869679.613806:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869679.614142:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545200512 00000100:00100000:0.0:1788869679.614156:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545200512 00000100:00100000:0.0:1788869679.614239:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 116 00000100:00100000:0.0:1788869679.614332:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+54:11372:x1875765545200512:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1788869679.614370:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869679.614529:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3469 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaab5e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.614578:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04600/0xbead52e175fc3470 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.614597:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04600/0xbead52e175fc3470 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.614611:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04600/0xbead52e175fc3470 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.614765:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3469 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab5e expref: 56 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.614796:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04600/0xbead52e175fc3470 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab5e expref: 55 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.614807:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:0.0:1788869679.614811:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788869679.614816:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04600, rc 0) 00000100:00100000:0.0:1788869679.614905:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+55:11372:x1875765545200512:12345-192.168.201.30@tcp:101:bash.0 Request processed in 655us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869679.614914:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 116 00000100:00100000:2.0:1788869679.618220:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869679.618446:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545200768 00000100:00100000:1.0:1788869679.618459:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545200768 00000100:00100000:1.0:1788869679.618595:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 117 00000100:00100000:1.0:1788869679.618607:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+55:11372:x1875765545200768:12345-192.168.201.30@tcp:36:bash.0 00010000:00010000:1.0:1788869679.618919:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3477 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.618942:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3477 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.618967:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3477 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788869679.619020:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1788869679.619048:0:6485:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ede1eb94 reply state 000000000bd7d35d transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3477 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.619063:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3477 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.619070:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:1.0:1788869679.619073:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788869679.619078:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788869679.619190:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+58:11372:x1875765545200768:12345-192.168.201.30@tcp:36:bash.0 Request processed in 585us (983us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788869679.619198:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 117 00000020:00080000:1.0:1788869679.619203:0:6485:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788869679.622596:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869679.622717:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545200896 00000100:00100000:0.0:1788869679.622731:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545200896 00000100:00100000:0.0:1788869679.622855:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 118 00000100:00100000:0.0:1788869679.622869:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+58:11372:x1875765545200896:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1788869679.622905:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869679.622935:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05600/0xbead52e175fc347e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaab65 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.623057:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3485 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.623076:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc345b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab57 expref: 59 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.623087:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3485 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.623132:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc345b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab57 expref: 59 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.623168:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc345b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab57 expref: 59 pid: 6484 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869679.623185:0:6484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6484:1875765554712064:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788869679.623602:0:6484:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43540 going to sleep for 11 seconds 00000100:00100000:2.0:1788869679.626685:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869679.626792:0:6484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6484:1875765554712064:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788869679.626827:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3485 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869679.626891:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545201024 00000100:00100000:3.0:1788869679.626932:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545201024 00010000:00010000:3.0:1788869679.626981:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc345b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab57 expref: 60 pid: 6484 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869679.627025:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00100000:3.0:1788869679.627036:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+60:2387:x1875765545201024:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869679.627055:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869679.627063:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc345b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab57 expref: 60 pid: 6484 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.627076:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc345b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab57 expref: 60 pid: 6484 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.627102:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc345b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab57 expref: 60 pid: 6484 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.627120:0:9488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:3.0:1788869679.627125:0:9488:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3485 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.627137:0:9488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.627145:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3485 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.627177:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869679.627294:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+59:2387:x1875765545201024:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 218us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.627314:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 71 00010000:00010000:1.0:1788869679.627600:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.627609:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869679.627679:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788869679.627683:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869679.627707:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.627741:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05600/0xbead52e175fc347e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab65 expref: 59 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.627773:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3485 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab65 expref: 58 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.627782:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:1.0:1788869679.627786:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869679.627788:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04800, rc 0) 00000100:00100000:1.0:1788869679.627821:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+58:11372:x1875765545200896:12345-192.168.201.30@tcp:101:bash.0 Request processed in 4956us (5240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869679.627828:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 118 00000100:00100000:2.0:1788869679.631111:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869679.631223:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545201280 00000100:00100000:0.0:1788869679.631237:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545201280 00000100:00100000:0.0:1788869679.631345:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:0.0:1788869679.631356:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+58:11372:x1875765545201280:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:0.0:1788869679.631668:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+59:11372:x1875765545201280:12345-192.168.201.30@tcp:35:bash.0 Request processed in 313us (569us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1788869679.631677:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:2.0:1788869679.692778:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869679.692894:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545201408 00000100:00100000:0.0:1788869679.692909:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545201408 00000100:00100000:0.0:1788869679.692993:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 119 00000100:00100000:0.0:1788869679.693006:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+59:11378:x1875765545201408:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1788869679.693040:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869679.693069:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc348c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaab6c expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.693154:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3493 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.693179:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3493 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.693193:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3493 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869679.693310:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788869679.693315:0:6486:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869679.693339:0:6486:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3493 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.693368:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc348c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab6c expref: 61 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.693389:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3493 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab6c expref: 60 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.693400:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:0.0:1788869679.693414:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869679.693418:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04000, rc 0) 00000100:00100000:0.0:1788869679.693495:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+60:11378:x1875765545201408:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 492us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869679.693503:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 119 00000100:00100000:2.0:1788869679.697608:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869679.697706:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545201536 00000100:00100000:1.0:1788869679.697719:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545201536 00000100:00100000:1.0:1788869679.697795:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 120 00000100:00100000:1.0:1788869679.697806:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+60:11378:x1875765545201536:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1788869679.697833:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869679.697860:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc349a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaab73 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.697946:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc34a1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.697964:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc34a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.697978:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc34a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.697992:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.698020:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.698028:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.698123:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.698133:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.698141:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869679.698193:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788869679.698198:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869679.698229:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.698242:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.698468:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc34a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.698478:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc34a1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.698485:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc34a1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.698505:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869679.698510:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc34a1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.698519:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc34a1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.698535:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:1.0:1788869679.698539:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869679.698544:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc34a1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.698551:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc34a1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.698569:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.698575:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.698582:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.698587:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031e00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869679.698590:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.698597:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.698617:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99ff88bbf900) 00010000:00010000:1.0:1788869679.698619:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869679.698623:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.698629:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.698662:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc349a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab73 expref: 62 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.698677:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab73 expref: 61 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.698685:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:1.0:1788869679.698688:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869679.698691:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80030a00, rc 0) 00000100:00100000:1.0:1788869679.698781:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+61:11378:x1875765545201536:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 976us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869679.698789:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 120 00000100:00100000:2.0:1788869679.703752:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869679.703801:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869679.703948:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545201792 00000100:00100000:1.0:1788869679.703961:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545201792 00000100:00100000:1.0:1788869679.704037:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 121 00000100:00100000:1.0:1788869679.704050:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+61:11378:x1875765545201792:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1788869679.704079:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869679.704109:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc34b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaab7a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.704598:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34bd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.704620:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3485 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab65 expref: 62 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.704629:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab73 expref: 62 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.704640:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34bd lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.704687:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab73 expref: 62 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.704703:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab73 expref: 62 pid: 6485 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869679.704721:0:6484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff89f7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6484:1875765554712192:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788869679.704845:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3485 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab65 expref: 62 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.704855:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3485 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab65 expref: 62 pid: 6484 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869679.704864:0:6484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff89f79c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6484:1875765554712320:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788869679.704903:0:6484:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89242b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869679.705578:0:9487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545201920 00000100:00100000:3.0:1788869679.705587:0:9487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545201920 00010000:00010000:3.0:1788869679.705623:0:9487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34af lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab73 expref: 63 pid: 6485 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869679.705664:0:9487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:3.0:1788869679.705672:0:9487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4fff62-1855-4361-a244-1a23eb291d37+63:2387:x1875765545201920:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869679.705685:0:9487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869679.705692:0:9487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34af lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab73 expref: 63 pid: 6485 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.705705:0:9487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab73 expref: 63 pid: 6485 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.705728:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:3.0:1788869679.705733:0:9487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34bd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.705741:0:9487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34bd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.705747:0:9487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869679.705795:0:9487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4fff62-1855-4361-a244-1a23eb291d37+63:2387:x1875765545201920:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 124us (1994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.705804:0:9487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 72 00010000:00010000:1.0:1788869679.710579:0:6484:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.30@tcp) returned -22 from blocking AST (req@000000000f0b151d x1875765554712192) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34af lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab73 expref: 62 pid: 6485 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.710613:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab73 expref: 62 pid: 6485 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869679.710638:0:6484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff89f7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6484:1875765554712192:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788869679.714165:0:6484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff89f79c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6484:1875765554712320:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788869679.714220:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:1.0:1788869679.714229:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34bd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.714243:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34bd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.714510:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34bd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869679.716174:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869679.716303:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545202048 00000100:00100000:3.0:1788869679.716328:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545202048 00010000:00010000:3.0:1788869679.716372:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3485 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab65 expref: 62 pid: 6484 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869679.716434:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00100000:3.0:1788869679.716445:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+62:2387:x1875765545202048:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869679.716463:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869679.716470:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3485 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab65 expref: 62 pid: 6484 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.716485:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3485 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab65 expref: 62 pid: 6484 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.716511:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3485 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab65 expref: 62 pid: 6484 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.716528:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:3.0:1788869679.716534:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34bd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.716545:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34bd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.716554:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34bd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.716580:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869679.716644:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+61:2387:x1875765545202048:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 200us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.716673:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 73 00010000:00010000:1.0:1788869679.716964:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34bd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.716975:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34bd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869679.716999:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788869679.717153:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc34b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab7a expref: 62 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.717183:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34bd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab7a expref: 61 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.717191:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:1.0:1788869679.717194:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788869679.717196:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80031e00, rc 0) 00000100:00100000:1.0:1788869679.717237:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+61:11378:x1875765545201792:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 13190us (13500us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788869679.717244:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 121 00000100:00100000:2.0:1788869679.727882:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869679.727981:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545202304 00000100:00100000:0.0:1788869679.727994:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545202304 00000100:00100000:0.0:1788869679.728075:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:0.0:1788869679.728088:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+61:11378:x1875765545202304:12345-192.168.201.30@tcp:103:lfs.0 00010000:00010000:0.0:1788869679.728109:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869679.728153:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc340e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab49 expref: 61 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.728174:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:0.0:1788869679.728181:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869679.728308:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+60:11378:x1875765545202304:12345-192.168.201.30@tcp:103:lfs.0 Request processed in 223us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869679.728317:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:3.0:1788869679.731542:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869679.731722:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545202432 00000100:00100000:1.0:1788869679.731736:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545202432 00000100:00100000:1.0:1788869679.731808:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 122 00000100:00100000:1.0:1788869679.731820:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+60:11378:x1875765545202432:12345-192.168.201.30@tcp:58:lfs.0 00010000:00010000:1.0:1788869679.731971:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc34cb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.731991:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc34cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.732004:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc34cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788869679.732132:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788869679.732242:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+60:11378:x1875765545202432:12345-192.168.201.30@tcp:58:lfs.0 Request processed in 423us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869679.732298:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 122 00000100:00100000:2.0:1788869679.749079:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869679.749307:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545202560 00000100:00100000:3.0:1788869679.749320:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545202560 00000100:00100000:3.0:1788869679.749413:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 123 00000100:00100000:3.0:1788869679.749426:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+60:11378:x1875765545202560:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869679.749454:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869679.749482:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc34d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaab81 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.749567:0:12967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc34cb lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.749580:0:12967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc34d2 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab81 expref: 61 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.749604:0:12967:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc34cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.749619:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc34d2 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab81 expref: 61 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.749636:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:3.0:1788869679.749640:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788869679.749645:0:12967:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc34d2 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab81 expref: 61 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.749653:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534a00, rc 0) 00000100:00100000:3.0:1788869679.749753:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+61:11378:x1875765545202560:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 330us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.749762:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 123 00000040:00080000:2.0:1788869679.768580:0:13761:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869679.768594:0:13761:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869679.768654:0:13761:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788869679.768668:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788869679.768849:0:13761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe838ee680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1875765554712448:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788869679.769041:0:13761:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae696900 going to sleep for 11 seconds 00000100:00100000:2.0:1788869679.775934:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869679.780049:0:13761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe838ee680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1875765554712448:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788869679.786411:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545202688 00000100:00100000:0.0:1788869679.786434:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545202688 00000100:00100000:0.0:1788869679.786530:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 124 00000100:00100000:0.0:1788869679.786542:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+61:11379:x1875765545202688:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788869679.786586:0:6484:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788869679.786785:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+61:11379:x1875765545202688:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 244us (10864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869679.786794:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 124 00000100:00100000:0.0:1788869679.790535:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869679.791163:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545202816 00000100:00100000:1.0:1788869679.791177:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545202816 00000100:00100000:1.0:1788869679.791720:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 125 00000100:00100000:1.0:1788869679.791734:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+61:11379:x1875765545202816:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788869679.791865:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34d9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.791893:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.791908:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.791945:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc34e0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.791953:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc34e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.791960:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc34e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792029:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc34e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792039:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc34e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792046:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc34e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869679.792119:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788869679.792147:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869679.792168:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc34e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792182:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792190:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34d9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792197:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792467:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80030a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869679.792473:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792483:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34d9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792606:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffb89e0700) 00010000:00010000:1.0:1788869679.792609:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869679.792614:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792621:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc34d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792640:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc34e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792646:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc34e0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792663:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc34e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792668:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869679.792671:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc34e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792677:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc34e0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792685:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff99fe831e6d00) 00010000:00010000:1.0:1788869679.792687:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869679.792690:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc34e0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792696:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc34e0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792712:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc34e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792719:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc34e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792725:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc34e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792730:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80030c00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869679.792732:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc34e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792747:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc34e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792755:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:1.0:1788869679.792758:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869679.792761:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc34e7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.792766:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc34e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869679.792916:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+61:11379:x1875765545202816:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 Request processed in 1182us (2396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869679.793107:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 125 00000100:00100000:2.0:1788869679.801468:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869679.812052:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545203072 00000100:00100000:0.0:1788869679.812073:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545203072 00000100:00100000:0.0:1788869679.812201:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 126 00000100:00100000:0.0:1788869679.812354:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+61:11379:x1875765545203072:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869679.812384:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869679.812426:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc34ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaab88 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.812581:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc34f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.812625:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc34f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.812640:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc34f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869679.812657:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788869679.812770:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc34f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.812779:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc34f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.812787:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc34f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.812794:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05c00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869679.812799:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc34f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.812807:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc34f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.812822:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:0.0:1788869679.812825:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788869679.812830:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc34f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.812837:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc34f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.812892:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc34ee lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab88 expref: 63 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.812912:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffb89e0700) 00010000:00010000:0.0:1788869679.812914:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788869679.812919:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc34ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab88 expref: 63 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.812929:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04200, rc 0) 00000100:00100000:0.0:1788869679.813031:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+62:11379:x1875765545203072:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 682us (11580us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1788869679.821111:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869679.821202:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545203200 00000100:00100000:1.0:1788869679.821224:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545203200 00000100:00100000:1.0:1788869679.821313:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 127 00000100:00100000:1.0:1788869679.821326:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+63:11379:x1875765545203200:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788869679.821377:0:9496:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788869679.821683:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+63:11379:x1875765545203200:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 358us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869679.821692:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 127 00000100:00100000:0.0:1788869679.823439:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 126 00000100:00100000:3.0:1788869679.828125:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869679.828380:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545203456 00000100:00100000:1.0:1788869679.828440:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545203456 00000100:00100000:1.0:1788869679.828532:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 128 00000100:00100000:1.0:1788869679.828544:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+62:11379:x1875765545203456:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869679.828573:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869679.828593:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788869679.828630:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3493 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab6c expref: 62 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.828651:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:1.0:1788869679.828657:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869679.828674:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3503 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaab8f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788869679.829169:0:6485:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788869679.829418:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc350a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.829434:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc350a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.829446:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc350a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.829501:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3503 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab8f expref: 64 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.829519:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc350a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab8f expref: 63 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.829528:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99fe831e6d00) 00010000:00010000:1.0:1788869679.829531:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869679.829534:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80031000, rc 0) 00000100:00100000:1.0:1788869679.829624:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+63:11379:x1875765545203456:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 1082us (1513us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788869679.829645:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 128 00000100:00100000:2.0:1788869679.837174:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869679.837307:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545203712 00000100:00100000:3.0:1788869679.837321:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545203712 00000100:00100000:3.0:1788869679.837389:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 129 00000100:00100000:3.0:1788869679.837414:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+63:11379:x1875765545203712:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788869679.837514:0:12967:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869679.837551:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc350a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab8f expref: 63 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.837576:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99fe831e6d00) 00010000:00010000:3.0:1788869679.837591:0:12967:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869679.837618:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3518 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.837636:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3518 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.837647:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3518 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.837666:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc351f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xc5cdfbe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.837673:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc351f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc5cdfbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.837679:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc351f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc5cdfbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.837759:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3518 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.837768:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3518 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.837775:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3518 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.837783:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869679.837788:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3518 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.837797:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3518 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.837807:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:3.0:1788869679.837810:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869679.837815:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3518 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.837822:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3518 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.837832:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc351f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc5cdfbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.837838:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc351f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc5cdfbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.837844:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc351f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc5cdfbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.837857:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534600 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869679.837860:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc351f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc5cdfbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.837867:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc351f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc5cdfbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.837876:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xc5cdfbe (ffff99ff88bbfa00) 00010000:00010000:3.0:1788869679.837879:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869679.837881:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc351f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xc5cdfbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.837887:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc351f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xc5cdfbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869679.837993:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+62:11379:x1875765545203712:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 594us (833us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788869679.838001:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 129 00000100:00100000:3.0:1788869679.848160:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869679.848535:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545203840 00000100:00100000:0.0:1788869679.848549:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545203840 00000100:00100000:0.0:1788869679.848623:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 130 00000100:00100000:0.0:1788869679.848635:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+62:11379:x1875765545203840:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869679.848661:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869679.848688:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3526 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaab96 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.848731:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc352d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.848748:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc352d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.848762:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc352d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.848894:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3526 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab96 expref: 64 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.848925:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc352d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab96 expref: 63 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.848935:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99fe821d6c00) 00010000:00010000:0.0:1788869679.848939:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788869679.848943:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb05400, rc 0) 00000100:00100000:0.0:1788869679.849028:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+63:11379:x1875765545203840:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 395us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869679.849035:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 130 00000100:00100000:0.0:1788869679.852773:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869679.853082:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545204096 00000100:00100000:2.0:1788869679.853094:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545204096 00000100:00100000:2.0:1788869679.853170:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 131 00000100:00100000:2.0:1788869679.853182:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+63:11379:x1875765545204096:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788869679.853342:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3534 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.853363:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3534 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.853376:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3534 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869679.853823:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:2.0:1788869679.853893:0:6484:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000011d21d84 reply state 000000001ddbef6a transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3534 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.853933:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3534 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.853942:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99fe821d6c00) 00010000:00010000:2.0:1788869679.853945:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788869679.853950:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869679.854092:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+65:11379:x1875765545204096:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 910us (1330us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788869679.854101:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 131 00000100:00100000:2.0:1788869679.858397:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869679.861841:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545204224 00000100:00100000:1.0:1788869679.861864:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545204224 00000100:00100000:1.0:1788869679.861957:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 132 00000100:00100000:1.0:1788869679.861970:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+65:11379:x1875765545204224:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869679.862006:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869679.862036:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc353b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaab9d expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.862119:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc353b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab9d expref: 66 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.862138:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc353b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab9d expref: 66 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.862160:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99fe821d6c00) 00010000:00010000:1.0:1788869679.862164:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869679.862168:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80030c00, rc 0) 00000100:00100000:2.0:1788869679.865115:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+66:11379:x1875765545204224:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 3127us (6721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869679.865132:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 132 00000100:00100000:0.0:1788869679.876883:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869679.878989:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545204352 00000100:00100000:1.0:1788869679.879011:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545204352 00000100:00100000:1.0:1788869679.879173:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:1.0:1788869679.879189:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+8:2388:x1875765545204352:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788869679.879549:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+9:2388:x1875765545204352:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 365us (2683us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788869679.879558:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:2.0:1788869679.882844:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869679.882943:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545204608 00000100:00100000:3.0:1788869679.882956:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545204608 00000100:00100000:3.0:1788869679.883030:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:3.0:1788869679.883043:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+66:11379:x1875765545204608:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788869679.883388:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+67:11379:x1875765545204608:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 347us (558us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1788869679.883397:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00080000:0.0:1788869679.883823:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869679.890389:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869679.890793:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545204864 00000100:00100000:1.0:1788869679.890829:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545204864 00000100:00100000:1.0:1788869679.890906:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 133 00000100:00100000:1.0:1788869679.890919:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+67:11379:x1875765545204864:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788869679.891080:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+67:11379:x1875765545204864:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 164us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869679.891089:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 133 00000100:00100000:0.0:1788869679.894775:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869679.894892:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545204992 00000100:00100000:3.0:1788869679.894922:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545204992 00000100:00100000:3.0:1788869679.895024:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 134 00000100:00100000:3.0:1788869679.895036:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+67:11379:x1875765545204992:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869679.895061:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869679.895087:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc3542 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaba4 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.895168:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3549 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.895186:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.895199:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869679.895308:0:12967:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869679.895331:0:12967:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.895358:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc3542 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaba4 expref: 69 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.895378:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3549 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaba4 expref: 68 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.895387:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99fe821d6c00) 00010000:00010000:3.0:1788869679.895391:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788869679.895395:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81535200, rc 0) 00000100:00100000:3.0:1788869679.895481:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+68:11379:x1875765545204992:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 448us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.895551:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 134 00000100:00100000:3.0:1788869679.898052:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869679.898143:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545205120 00000100:00100000:0.0:1788869679.898153:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545205120 00000100:00100000:0.0:1788869679.898207:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:0.0:1788869679.898215:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+9:2387:x1875765545205120:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869679.898232:0:8399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869679.898284:0:8399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000075b6ffc/0xbead52e175fc3550 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaabab expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788869679.898309:0:8399:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ffc30, blocks: 0x0 00010000:00010000:0.0:1788869679.898329:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=297s v=(0 0) 00010000:00010000:0.0:1788869679.898334:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869679.898342:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000075b6ffc/0xbead52e175fc3550 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabab expref: 10 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.898371:0:8399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000075b6ffc/0xbead52e175fc3550 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabab expref: 10 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.898384:0:8399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb05000, rc 0) 00000100:00100000:0.0:1788869679.898462:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+10:2387:x1875765545205120:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 247us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869679.898468:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:2.0:1788869679.902381:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869679.902735:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545205376 00000100:00100000:3.0:1788869679.902748:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545205376 00000100:00100000:3.0:1788869679.902812:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 135 00000100:00100000:3.0:1788869679.902824:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+68:11379:x1875765545205376:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788869679.902965:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+68:11379:x1875765545205376:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 143us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.902973:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 135 00000100:00100000:1.0:1788869679.905422:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869679.905557:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545205504 00000100:00100000:2.0:1788869679.905565:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545205504 00000100:00100000:2.0:1788869679.905617:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:2.0:1788869679.905628:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+10:11379:x1875765545205504:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869679.905651:0:8401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869679.905673:0:8401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000302964ca/0xbead52e175fc3557 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaabb2 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.905707:0:8401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000075b6ffc/0xbead52e175fc3550 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabab expref: 11 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.905734:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869679.905738:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869679.905742:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000302964ca/0xbead52e175fc3557 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabb2 expref: 11 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.905780:0:8401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000075b6ffc/0xbead52e175fc3550 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabab expref: 11 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.905791:0:8401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000075b6ffc/0xbead52e175fc3550 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabab expref: 11 pid: 8399 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869679.905803:0:8401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe838ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8401:1875765554712576:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788869679.905891:0:8401:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae696b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869679.907677:0:8401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe838ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8401:1875765554712576:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788869679.907710:0:8401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000302964ca/0xbead52e175fc3557 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabb2 expref: 11 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.907730:0:8401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1a00, rc 0) 00000100:00100000:2.0:1788869679.907820:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869679.907854:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+11:11379:x1875765545205504:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 2228us (2452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869679.907863:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:3.0:1788869679.907867:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545205632 00000100:00100000:3.0:1788869679.907875:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545205632 00010000:00010000:3.0:1788869679.907908:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000075b6ffc/0xbead52e175fc3550 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabab expref: 11 pid: 8399 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869679.908031:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 74 00000100:00100000:3.0:1788869679.908042:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+11:2387:x1875765545205632:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869679.908059:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869679.908087:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000075b6ffc/0xbead52e175fc3550 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabab expref: 11 pid: 8399 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.908101:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000075b6ffc/0xbead52e175fc3550 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabab expref: 11 pid: 8399 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.908129:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000075b6ffc/0xbead52e175fc3550 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabab expref: 11 pid: 8399 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.908168:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869679.908173:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869679.908220:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000302964ca/0xbead52e175fc3557 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabb2 expref: 10 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.908233:0:6469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000302964ca/0xbead52e175fc3557 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabb2 expref: 10 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.908308:0:6469:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000302964ca/0xbead52e175fc3557 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabb2 expref: 10 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869679.908325:0:6469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb44700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6469:1875765554712704:192.168.201.30@tcp:105: 00000100:00100000:0.0:1788869679.908441:0:6469:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe810db300 going to sleep for 11 seconds 00000100:00100000:1.0:1788869679.912591:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869679.912781:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545205760 00000100:00100000:3.0:1788869679.912795:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545205760 00002000:00100000:3.0:1788869679.912866:0:8404:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff99ff89f7b100 x1875765545205760/t0(0) o4->bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp:625/0 lens 504/0 e 0 to 0 dl 1788869690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788869679.912879:0:8404:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ff89f7b100 with x1875765545205760 ext(0->12) 00002000:00010000:3.0:1788869679.912886:0:8404:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ff89f7b100 00000100:00100000:3.0:1788869679.912962:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:3.0:1788869679.912973:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf4fff62-1855-4361-a244-1a23eb291d37+11:2388:x1875765545205760:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788869679.913720:0:6469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb44700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6469:1875765554712704:192.168.201.30@tcp:105: 00010000:00010000:0.0:1788869679.913746:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869679.913807:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+13:2387:x1875765545205632:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 5766us (6318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869679.913818:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 74 00000100:00100000:3.0:1788869679.914133:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf4fff62-1855-4361-a244-1a23eb291d37+12:2388:x1875765545205760:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 Request processed in 1160us (1555us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788869679.914142:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00002000:00100000:3.0:1788869679.914160:0:8404:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff99ff89f7b100 x1875765545205760/t4294967309(0) o4->bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp:625/0 lens 504/448 e 0 to 0 dl 1788869690 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788869679.914170:0:8404:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ff89f7b100 with x1875765545205760 ext(0->12) 00002000:00010000:3.0:1788869679.914177:0:8404:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ff89f7b100 00000100:00100000:1.0:1788869679.915703:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869679.915766:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545205888 00000100:00100000:2.0:1788869679.915774:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545205888 00000100:00100000:2.0:1788869679.915832:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 136 00000100:00100000:2.0:1788869679.915843:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+68:11379:x1875765545205888:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788869679.917010:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1788869679.917049:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:2.0:1788869679.917050:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc325c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917063:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc325c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917072:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc325c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788869679.917074:0:6463:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99fe82c43d80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788869679.917078:0:6463:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99fe81c5c700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99fe82c43b40 00000020:00080000:1.0:1788869679.917082:0:6463:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99fe81c5c800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fe838d7e00 00010000:00010000:2.0:1788869679.917086:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869679.917092:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc325c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917101:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc325c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917121:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99fe831e3600) 00000004:00080000:1.0:1788869679.917122:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:2.0:1788869679.917124:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869679.917130:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc325c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917137:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc325c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788869679.917158:0:6463:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ff8831bd80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788869679.917161:0:6463:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99ffbfb40b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ff8831bf00 00010000:00010000:2.0:1788869679.917167:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3304 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788869679.917171:0:6463:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99ffbfb40e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99ff98c1d400 00010000:00010000:2.0:1788869679.917174:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3304 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917179:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3304 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917184:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869679.917187:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3304 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917193:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3304 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917222:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99ff88bbf200) 00010000:00010000:2.0:1788869679.917224:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869679.917228:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3304 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917233:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3304 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917287:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc3382 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917294:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc3382 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917299:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc3382 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917304:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869679.917307:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc3382 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917312:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc3382 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917319:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99ff88bbf900) 00010000:00010000:2.0:1788869679.917322:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869679.917324:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc3382 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917330:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc3382 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917351:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc33a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917358:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc33a5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869679.917360:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1788869679.917363:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc33a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917368:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869679.917371:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc33a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917377:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc33a5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917385:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99ff88bbf900) 00010000:00010000:2.0:1788869679.917388:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869679.917390:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc33a5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869679.917392:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554712832:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788869679.917397:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc33a5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917423:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3477 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917429:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3477 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917434:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3477 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917445:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80030000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869679.917448:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3477 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917453:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3477 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917461:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:2.0:1788869679.917463:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869679.917466:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3477 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917471:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3477 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869679.917485:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869679.917485:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3534 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917490:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3534 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917496:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3534 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917501:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869679.917503:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3534 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917509:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3534 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917525:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99fe821d6c00) 00010000:00010000:2.0:1788869679.917527:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788869679.917531:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3534 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.917537:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3534 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869679.917567:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554712960:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788869679.917594:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869679.917623:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554712832 00000100:00100000:3.0:1788869679.917629:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554712832 00000100:00100000:2.0:1788869679.917666:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+16:11379:x1875765545205888:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 Request processed in 1823us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.917672:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554712960 00000100:00100000:3.0:1788869679.917675:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554712960 00000100:00100000:2.0:1788869679.917676:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 136 00000100:00100000:3.0:1788869679.917695:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788869679.917702:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3617:x1875765554712832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788869679.917730:0:8527:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:3.0:1788869679.917756:0:8527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc355e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.917778:0:8527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000025452db7/0xbead52e175fc3312 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab0a expref: 11 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.917788:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788869679.917793:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788869679.917798:0:8527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc355e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.917840:0:8527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000025452db7/0xbead52e175fc3312 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab0a expref: 11 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.917855:0:8527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000025452db7/0xbead52e175fc3312 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab0a expref: 11 pid: 8527 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869679.917869:0:8527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb46300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8527:1875765554713088:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869679.918021:0:8527:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb95ad9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869679.918040:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788869679.918048:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1875765554712960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788869679.918063:0:8400:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:3.0:1788869679.918123:0:8400:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ffc2f, atime: 0x0, ctime: 0x6a9ffc2f, blocks: 0x8 00010000:00010000:3.0:1788869679.918128:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc3565 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.918135:0:8400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=297s v=(0 0) 00010000:00010000:3.0:1788869679.918138:0:8400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869679.918142:0:8400:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc3565 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.918151:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc3565 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.918157:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc3565 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.918167:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc3565 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.918185:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869679.918284:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869679.918290:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc3565 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.918298:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535400 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869679.918301:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc3565 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.918310:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc3565 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.918324:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc3565 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.918331:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc3565 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.918361:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869679.918363:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869679.918365:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869679.918377:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3617:x1875765554712960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 329us (781us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788869679.918383:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1788869679.918441:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffbfb45c00/2, rc 0, transno 4294967305 00000100:00100000:3.0:1788869679.918448:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554712960:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1788869679.918600:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1788869679.918649:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00080000:0.0:1788869679.918660:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869679.920457:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869679.920610:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545206016 00000100:00100000:3.0:1788869679.920614:0:8527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb46300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8527:1875765554713088:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788869679.920619:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545206016 00010000:00010000:3.0:1788869679.920645:0:8527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc355e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.920660:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000025452db7/0xbead52e175fc3312 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab0a expref: 12 pid: 8527 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869679.920709:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 75 00000100:00100000:2.0:1788869679.920719:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+12:2388:x1875765545206016:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869679.920737:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869679.920744:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000025452db7/0xbead52e175fc3312 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab0a expref: 12 pid: 8527 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.920758:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000025452db7/0xbead52e175fc3312 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab0a expref: 12 pid: 8527 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.920785:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025452db7/0xbead52e175fc3312 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab0a expref: 12 pid: 8527 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.920802:0:9488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869679.920808:0:9488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869679.920815:0:9488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc355e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.920846:0:9488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc355e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.920880:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869679.920965:0:8527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc355e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.920975:0:8527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc355e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869679.920982:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+11:2388:x1875765545206016:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 264us (535us total) trans 0 rc 0/0 00010000:00010000:3.0:1788869679.920985:0:8527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc355e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869679.920989:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 75 00010000:00010000:3.0:1788869679.920994:0:8527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc355e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.921031:0:8527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869679.921150:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869679.921156:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc355e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.921165:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534600 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869679.921170:0:7425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc355e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.921179:0:7425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc355e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.921190:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc355e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.921197:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc355e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869679.921214:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3617:x1875765554712832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3512us (3728us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788869679.921222:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:2.0:1788869679.921237:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869679.921245:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869679.921247:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788869679.921987:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffbfb47480/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788869679.922010:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554712832:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788869679.922682:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869679.922801:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545206144 00000100:00100000:0.0:1788869679.922808:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545206144 00000100:00100000:0.0:1788869679.922853:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:0.0:1788869679.922864:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+11:2389:x1875765545206144:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788869679.924043:0:8393:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1788869679.924052:0:8393:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1788869679.924210:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2389:x1875765545206144:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 Request processed in 1335us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869679.924221:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:1.0:1788869679.926106:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869679.926197:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545206400 00000100:00100000:3.0:1788869679.926207:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545206400 00000100:00100000:1.0:1788869679.926471:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 137 00000100:00100000:1.0:1788869679.926483:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+16:11379:x1875765545206400:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788869679.926552:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869679.926587:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3549 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaba4 expref: 16 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.926606:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99fe821d6c00) 00010000:00010000:1.0:1788869679.926610:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869679.926642:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc356c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.926655:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc356c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.926664:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc356c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788869679.926800:0:6485:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000047285bbb reply state 000000002c8e879f transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc356c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.926814:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc356c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.926819:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99fe821d6c00) 00010000:00010000:1.0:1788869679.926823:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788869679.926825:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788869679.926979:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+17:11379:x1875765545206400:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 498us (881us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1788869679.926988:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 137 00000100:00100000:1.0:1788869679.928303:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869679.928467:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545206528 00000100:00100000:3.0:1788869679.928477:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545206528 00000100:00100000:3.0:1788869679.928525:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:3.0:1788869679.928536:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+6:2387:x1875765545206528:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788869679.928692:0:8401:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788869679.928695:0:8401:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788869680 00002000:00010000:3.0:1788869679.928697:0:8401:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788869680 00002000:00010000:3.0:1788869679.928699:0:8401:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788869680 -> 1788869680 00002000:00010000:3.0:1788869679.928701:0:8401:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788869679.928774:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+7:2387:x1875765545206528:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 241us (477us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788869679.928779:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:3.0:1788869679.929916:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869679.929996:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545206784 00000100:00100000:2.0:1788869679.930003:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545206784 00000100:00100000:2.0:1788869679.930047:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 138 00000100:00100000:2.0:1788869679.930056:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+17:11379:x1875765545206784:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788869679.930128:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3573 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.930143:0:9496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc352d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab96 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.930150:0:9496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3573 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.930185:0:9496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc352d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab96 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.930196:0:9496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc352d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab96 expref: 17 pid: 6486 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869679.930213:0:9496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe838ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9496:1875765554713216:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788869679.930339:0:9496:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae696900 going to sleep for 11 seconds 00000100:00100000:2.0:1788869679.931884:0:9496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe838ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9496:1875765554713216:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788869679.931918:0:9496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3573 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869679.932899:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869679.933099:0:9487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545206912 00000100:00100000:2.0:1788869679.933115:0:9487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545206912 00010000:00010000:2.0:1788869679.933161:0:9487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc352d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab96 expref: 18 pid: 6486 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869679.933209:0:9487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 76 00000100:00100000:2.0:1788869679.933220:0:9487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4fff62-1855-4361-a244-1a23eb291d37+18:2387:x1875765545206912:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869679.933238:0:9487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869679.933246:0:9487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc352d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab96 expref: 18 pid: 6486 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.933299:0:9487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc352d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab96 expref: 18 pid: 6486 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.933329:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc352d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab96 expref: 18 pid: 6486 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.933349:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99fe821d6c00) 00010000:00010000:2.0:1788869679.933355:0:9487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3573 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.933366:0:9487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3573 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.933374:0:9487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3573 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.933400:0:9487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869679.933488:0:9487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4fff62-1855-4361-a244-1a23eb291d37+17:2387:x1875765545206912:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 270us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869679.933508:0:9487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 76 00010000:00010000:3.0:1788869679.934088:0:9496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3573 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.934099:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3573 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.934155:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3573 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.934163:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3573 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.934170:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3573 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.934176:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869679.934181:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3573 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.934189:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3573 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.934201:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99fe821d6c00) 00010000:00010000:3.0:1788869679.934204:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788869679.934208:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3573 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.934216:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3573 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869679.934333:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+16:11379:x1875765545206784:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 Request processed in 4276us (4419us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788869679.934355:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 138 00000100:00100000:3.0:1788869679.936113:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869679.936227:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545207040 00000100:00100000:0.0:1788869679.936393:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545207040 00000100:00100000:0.0:1788869679.936497:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:0.0:1788869679.936509:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+7:2388:x1875765545207040:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788869679.936570:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fd3affe2/0xbead52e175fc357a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.936597:0:8399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000302964ca/0xbead52e175fc3557 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabb2 expref: 7 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.936606:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869679.936610:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869679.936616:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3affe2/0xbead52e175fc357a lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.936662:0:8399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000302964ca/0xbead52e175fc3557 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabb2 expref: 7 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.936677:0:8399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000302964ca/0xbead52e175fc3557 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabb2 expref: 7 pid: 8401 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869679.936696:0:8399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8399:1875765554713344:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788869679.936862:0:8399:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869679.940557:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869679.940703:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545207168 00000100:00100000:1.0:1788869679.940715:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545207168 00010000:00010000:1.0:1788869679.940770:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000302964ca/0xbead52e175fc3557 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabb2 expref: 8 pid: 8401 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869679.940826:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 77 00000100:00100000:1.0:1788869679.940838:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+8:2387:x1875765545207168:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869679.940857:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869679.940885:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000302964ca/0xbead52e175fc3557 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabb2 expref: 8 pid: 8401 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.940901:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000302964ca/0xbead52e175fc3557 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabb2 expref: 8 pid: 8401 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.940948:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788869679.940955:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788869679.940963:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd3affe2/0xbead52e175fc357a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.940976:0:6469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3affe2/0xbead52e175fc357a lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.941004:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869679.941197:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+8:2387:x1875765545207168:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 360us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869679.941213:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 77 00010000:00010000:3.0:1788869679.941543:0:8399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000302964ca/0xbead52e175fc3557 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabb2 expref: 7 pid: 8401 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869679.941564:0:8399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8399:1875765554713344:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869679.941601:0:8399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fd3affe2/0xbead52e175fc357a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.941677:0:8399:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fd3affe2/0xbead52e175fc357a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.941686:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3affe2/0xbead52e175fc357a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.941726:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fd3affe2/0xbead52e175fc357a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.941735:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3affe2/0xbead52e175fc357a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.941744:0:8399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3affe2/0xbead52e175fc357a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.941751:0:8399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04a00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869679.941755:0:8399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3affe2/0xbead52e175fc357a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.941765:0:8399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3affe2/0xbead52e175fc357a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.941779:0:8399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3affe2/0xbead52e175fc357a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.941786:0:8399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3affe2/0xbead52e175fc357a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869679.941850:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:2388:x1875765545207040:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 Request processed in 5343us (5747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869679.941859:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:1.0:1788869679.946037:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869679.946154:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545207424 00000100:00100000:2.0:1788869679.946167:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545207424 00000100:00100000:2.0:1788869679.946244:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 139 00000100:00100000:2.0:1788869679.946295:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+16:11379:x1875765545207424:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788869679.946403:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3581 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.946435:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04600/0xbead52e175fc3470 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab5e expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.946446:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3581 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.946493:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04600/0xbead52e175fc3470 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab5e expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869679.946509:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04600/0xbead52e175fc3470 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab5e expref: 16 pid: 6486 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869679.946528:0:6484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe838ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6484:1875765554713472:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788869679.946634:0:6484:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae696900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869679.949677:0:6484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe838ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6484:1875765554713472:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788869679.949681:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:0.0:1788869679.949715:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3581 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869679.949780:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545207552 00000100:00100000:3.0:1788869679.949790:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545207552 00010000:00010000:3.0:1788869679.949838:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04600/0xbead52e175fc3470 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab5e expref: 17 pid: 6486 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869679.949883:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:3.0:1788869679.949894:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+17:2387:x1875765545207552:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869679.949913:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869679.949921:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04600/0xbead52e175fc3470 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab5e expref: 17 pid: 6486 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.949944:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04600/0xbead52e175fc3470 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab5e expref: 17 pid: 6486 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.949973:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04600/0xbead52e175fc3470 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab5e expref: 17 pid: 6486 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.950015:0:9488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:3.0:1788869679.950023:0:9488:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc34d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab81 expref: 16 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.950035:0:9488:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3581 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.950044:0:9488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3581 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.950055:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3581 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.950087:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869679.950158:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+16:2387:x1875765545207552:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 266us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.950167:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 78 00010000:00010000:0.0:1788869679.950655:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3581 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.950663:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3581 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.950900:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc3588 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.950914:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc353b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab9d expref: 16 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.950924:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc3588 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.950963:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc353b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab9d expref: 16 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.950979:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc353b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab9d expref: 16 pid: 9496 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869679.950994:0:6484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6484:1875765554713600:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788869679.951121:0:6484:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43840 going to sleep for 11 seconds 00000100:00100000:2.0:1788869679.955441:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869679.956838:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545207680 00000100:00100000:1.0:1788869679.956856:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545207680 00010000:00010000:1.0:1788869679.956938:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc353b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab9d expref: 17 pid: 9496 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869679.957000:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00100000:1.0:1788869679.957013:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+17:2388:x1875765545207680:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869679.957033:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869679.957040:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc353b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab9d expref: 17 pid: 9496 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.957056:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc353b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab9d expref: 17 pid: 9496 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.957087:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99fe821d6c00) 00010000:00010000:1.0:1788869679.957093:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc3588 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.957105:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc3588 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.957114:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc3588 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.957139:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869679.957237:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+17:2388:x1875765545207680:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 226us (1809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869679.957245:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 79 00010000:00010000:0.0:1788869679.957620:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc353b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab9d expref: 16 pid: 9496 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869679.957655:0:6484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6484:1875765554713600:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788869679.957681:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc3588 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.957690:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc3588 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.957696:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc3588 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869679.957841:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1788869679.957984:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1788869679.958025:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1788869679.958131:0:6484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6484:1875765554713728:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788869679.958216:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869679.958280:0:6484:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8bdb000 going to sleep for 11 seconds 00000100:00100000:0.0:1788869679.961163:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554713728 00000100:00100000:0.0:1788869679.961186:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554713728 00000100:00100000:0.0:1788869679.961701:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788869679.961717:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6484:x1875765554713728:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788869679.961937:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6484:x1875765554713728:12345-0@lo:1000:mdt00_000.0 Request processed in 215us (3710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869679.961945:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788869679.962023:0:6484:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788869679.962031:0:6484:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:3.0:1788869679.962056:0:6484:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffbfb47480, transno 4294967310 00000100:00100000:3.0:1788869679.962074:0:6484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6484:1875765554713728:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788869679.963958:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:3.0:1788869679.964077:0:6484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb44380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6484:1875765554713856:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788869679.964158:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869679.969279:0:6484:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788869679.971600:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554713856 00000100:00100000:2.0:1788869679.971621:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554713856 00000100:00100000:2.0:1788869679.971722:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788869679.971756:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6484:x1875765554713856:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788869679.972087:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6484:x1875765554713856:12345-0@lo:1000:mdt00_000.0 Request processed in 333us (7926us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788869679.972098:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788869679.972331:0:6484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb44380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6484:1875765554713856:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788869679.972442:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc3588 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.972456:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc3588 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.972466:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc3588 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.972473:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869679.972479:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc3588 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.972488:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc3588 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.972511:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99fe821d6c00) 00010000:00010000:1.0:1788869679.972515:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869679.972521:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc3588 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.972528:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc3588 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.972562:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc34cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.972582:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc34cb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.972589:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc34cb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.972594:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869679.972598:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc34cb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.972605:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc34cb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.972614:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:1.0:1788869679.972617:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869679.972627:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc34d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab81 expref: 19 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.972641:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc34d2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab81 expref: 19 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.972652:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc34d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab81 expref: 19 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.972694:0:6484:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc34d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab81 expref: 19 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869679.972712:0:6484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff89f79180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6484:1875765554713984:192.168.201.30@tcp:105: 00000100:00100000:1.0:1788869679.972959:0:6484:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89242480 going to sleep for 11 seconds 00000100:00100000:2.0:1788869679.977645:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869679.978012:0:6484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff89f79180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6484:1875765554713984:192.168.201.30@tcp:105: 00010000:00010000:1.0:1788869679.978049:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc34cb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.978063:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc34cb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.978111:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc358f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.978129:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc358f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.978145:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc358f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.978158:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc358f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.978164:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc358f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.978171:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc358f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.978176:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80030000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869679.978180:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc358f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.978187:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc358f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.978391:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:1.0:1788869679.978394:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869679.978399:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc358f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.978413:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc358f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.978424:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3581 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.978430:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3581 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.978436:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3581 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.978442:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869679.978445:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3581 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.978452:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3581 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.978461:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:1.0:1788869679.978464:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788869679.978466:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3581 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869679.978472:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3581 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869679.978750:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+19:11379:x1875765545207424:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 32458us (32727us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788869679.978763:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 139 00000020:00080000:1.0:1788869679.978770:0:6484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788869679.978961:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545207808 00000100:00100000:3.0:1788869679.978971:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545207808 00000100:00100000:3.0:1788869679.979027:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:3.0:1788869679.979047:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+19:11378:x1875765545207808:12345-192.168.201.30@tcp:49:lfs.0 00000100:00100000:3.0:1788869679.979158:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+19:11378:x1875765545207808:12345-192.168.201.30@tcp:49:lfs.0 Request processed in 114us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869679.979166:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 31 00000040:00080000:2.0:1788869679.980222:0:13761:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869679.980230:0:13761:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869679.981093:0:13761:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788869679.981106:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788869679.983472:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869679.984804:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545208064 00000100:00100000:3.0:1788869679.984820:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545208064 00000100:00100000:3.0:1788869679.985000:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:3.0:1788869679.985015:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae5b8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+19:11379:x1875765545208064:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788869679.985535:0:6488:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788869679.985582:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1788869679.985660:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3596 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.985682:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3596 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.985696:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3596 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.985707:0:6488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3596 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.985714:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3596 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.985722:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3596 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869679.985740:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788869679.985866:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae5b8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+21:11379:x1875765545208064:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 853us (2404us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788869679.985894:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:2.0:1788869679.986141:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869679.986181:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545208320 00000100:00100000:2.0:1788869679.986188:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545208320 00000100:00100000:2.0:1788869679.986240:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 140 00000100:00100000:2.0:1788869679.986273:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+22:11378:x1875765545208320:12345-192.168.201.30@tcp:58:lfs.0 00000040:00080000:2.0:1788869679.986435:0:12967:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788869679.986476:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+22:11378:x1875765545208320:12345-192.168.201.30@tcp:58:lfs.0 Request processed in 227us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869679.986483:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 140 00000020:00080000:3.0:1788869679.987107:0:6488:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788869679.987229:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869679.987240:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3596 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.987271:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535400 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869679.987288:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3596 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.987298:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3596 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.987318:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99fe821d6c00) 00010000:00010000:0.0:1788869679.987321:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788869679.987328:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3596 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.987335:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3596 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869679.987354:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869679.987356:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869679.987358:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869680.026511:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869680.026634:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545208448 00000100:00100000:2.0:1788869680.026649:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545208448 00000100:00100000:2.0:1788869680.026790:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 141 00000100:00100000:2.0:1788869680.026804:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+21:11381:x1875765545208448:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1788869680.026852:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869680.026881:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1200/0xbead52e175fc359d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaabb9 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869680.026983:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc35a4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869680.027018:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc35a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869680.027031:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc35a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869680.027051:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc35ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869680.027058:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc35ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869680.027064:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc35ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869680.027155:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc35b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869680.027167:0:9496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34bd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab7a expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869680.027177:0:9496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc35b2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869680.027220:0:9496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34bd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab7a expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869680.027235:0:9496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34bd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab7a expref: 22 pid: 6484 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869680.027291:0:9496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe838ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9496:1875765554714112:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788869680.027397:0:9496:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae696900 going to sleep for 11 seconds 00000100:00100000:1.0:1788869680.041734:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869680.041918:0:9496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe838ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9496:1875765554714112:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788869680.041955:0:9496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc35b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869680.042999:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545208704 00000100:00100000:3.0:1788869680.043013:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545208704 00000100:00100000:3.0:1788869680.043143:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:3.0:1788869680.043155:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+23:6152:x1875765545208704:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788869680.043538:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+24:6152:x1875765545208704:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 383us (1817us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788869680.043546:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:2.0:1788869680.050633:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869680.050742:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545208832 00000100:00100000:1.0:1788869680.050756:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545208832 00010000:00010000:1.0:1788869680.050814:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34bd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab7a expref: 24 pid: 6484 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869680.050992:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 80 00000100:00100000:1.0:1788869680.051006:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+24:2388:x1875765545208832:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869680.051027:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869680.051037:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34bd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab7a expref: 24 pid: 6484 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869680.051053:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34bd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab7a expref: 24 pid: 6484 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869680.051082:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc34bd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab7a expref: 24 pid: 6484 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869680.051103:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:1.0:1788869680.051110:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc35b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869680.051144:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc35b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869680.051153:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc35b2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869680.051195:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869680.051511:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+23:2388:x1875765545208832:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 507us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869680.051521:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 80 00010000:00010000:3.0:1788869680.051922:0:9496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc35b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869680.051933:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc35b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869680.052003:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788869680.052008:0:9496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869680.052035:0:9496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc35b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869680.052053:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc35b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869680.052064:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc35a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869680.052072:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc35a4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869680.052093:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc35a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869680.052100:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869680.052105:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc35a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869680.052114:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc35a4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869680.052126:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:3.0:1788869680.052129:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869680.052133:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc35a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869680.052140:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc35a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869680.052155:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc35ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869680.052162:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc35ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869680.052169:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc35ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869680.052174:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869680.052176:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc35ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869680.052191:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc35ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869680.052200:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99ffb89e1000) 00010000:00010000:3.0:1788869680.052203:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869680.052218:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc35ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869680.052225:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc35ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869680.052532:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1200/0xbead52e175fc359d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabb9 expref: 23 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869680.052551:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc35b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabb9 expref: 22 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869680.052558:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:3.0:1788869680.052561:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869680.052563:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0a00, rc 0) 00000100:00100000:3.0:1788869680.052625:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+22:11381:x1875765545208448:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 25824us (26127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869680.052633:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 141 00010000:00010000:2.0:1788869680.153275:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869680.537355:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554714240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869680.537441:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869680.537517:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554714240 00000100:00100000:3.0:1788869680.537524:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554714240 00000100:00100000:3.0:1788869680.537581:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788869680.537590:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554714240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869680.538358:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788869680.538443:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554714240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 853us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869680.538451:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788869680.538511:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554714240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869680.539187:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869680.539200:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe838ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554714368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869680.539384:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869680.539576:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554714368 00000100:00100000:2.0:1788869680.539583:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554714368 00000100:00100000:2.0:1788869680.539635:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788869680.539643:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3618:x1875765554714368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869680.539662:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3691950080 00000100:00100000:2.0:1788869680.539708:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3618:x1875765554714368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869680.539715:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788869680.539819:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe838ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554714368:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788869680.927923:0:14223:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869680.927932:0:14223:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869680.927962:0:14223:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788869680.927969:0:14223:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788869680.990699:0:13761:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788869680.990709:0:13761:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788869680.990734:0:13761:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788869680.990742:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788869680.990871:0:13761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff89f79880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1875765554714496:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788869680.991030:0:13761:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8aa5900 going to sleep for 11 seconds 00000100:00100000:1.0:1788869681.005118:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869681.005157:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545208960 00000100:00100000:1.0:1788869681.005166:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545208960 00000100:00100000:1.0:1788869681.005236:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 142 00000100:00100000:1.0:1788869681.005246:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+23:11392:x1875765545208960:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788869681.005319:0:6484:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788869681.005608:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+23:11392:x1875765545208960:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 362us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869681.005618:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 142 00000100:00080000:1.0:1788869681.005641:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869681.013247:0:13761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff89f79880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1875765554714496:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788869681.028188:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869681.028520:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545209216 00000100:00100000:0.0:1788869681.028530:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545209216 00000100:00100000:0.0:1788869681.028614:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 143 00000100:00100000:0.0:1788869681.028625:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+22:11392:x1875765545209216:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869681.028645:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869681.028666:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc35b9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaabc0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869681.028787:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc35c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869681.028808:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc35c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869681.028819:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc35c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869681.028831:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788869681.028953:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc35b9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabc0 expref: 25 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869681.028972:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc35c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabc0 expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869681.028981:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:0.0:1788869681.028984:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869681.028988:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04800, rc 0) 00000100:00100000:0.0:1788869681.029052:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+24:11392:x1875765545209216:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 429us (874us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788869681.029060:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 143 00000100:00100000:3.0:1788869681.049979:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554714624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869681.050050:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869681.050110:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554714624 00000100:00100000:3.0:1788869681.050118:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554714624 00000100:00100000:3.0:1788869681.050171:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788869681.050181:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554714624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869681.050628:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3691950080 00000100:00100000:3.0:1788869681.050679:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554714624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 499us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869681.050687:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788869681.050739:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554714624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869681.050989:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869681.051019:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00080000:1.0:1788869681.051147:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869681.053492:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545209344 00000100:00100000:3.0:1788869681.053506:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545209344 00000100:00100000:3.0:1788869681.053582:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:3.0:1788869681.053592:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89da9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+24:2387:x1875765545209344:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869681.053607:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869681.053631:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc35c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabc0 expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869681.053661:0:9488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:3.0:1788869681.053666:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869681.053722:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89da9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+23:2387:x1875765545209344:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 131us (2736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869681.053730:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:3.0:1788869681.053786:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545209600 00000100:00100000:3.0:1788869681.053790:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545209600 00000100:00100000:3.0:1788869681.053815:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 144 00000100:00100000:3.0:1788869681.053822:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+23:11392:x1875765545209600:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788869681.053887:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc35ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869681.053901:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc35ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869681.053911:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc35ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869681.054049:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc35ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869681.054056:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc35ce lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869681.054063:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc35ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869681.054069:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869681.054079:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc35ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869681.054086:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc35ce lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869681.054094:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:3.0:1788869681.054096:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788869681.054100:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc35ce lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869681.054106:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc35ce lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869681.054180:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+24:11392:x1875765545209600:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 358us (3160us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788869681.054187:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 144 00000040:00080000:3.0:1788869681.054305:0:13761:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788869681.054310:0:13761:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788869681.054786:0:13761:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788869681.054793:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788869681.055814:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554714880:0@lo:400:kworker.0 00000100:00100000:0.0:1788869681.055874:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869681.055920:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554715392:0@lo:400:kworker.0 00000100:00100000:0.0:1788869681.055951:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869681.055966:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff832e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875765554715904:0@lo:400:kworker.0 00000100:00100000:0.0:1788869681.056000:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869681.056020:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788869681.056026:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554715008:0@lo:400:kworker.0 00000100:00100000:0.0:1788869681.056045:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869681.056058:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554715520:0@lo:400:kworker.0 00000100:00100000:0.0:1788869681.056078:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869681.056105:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554714880 00000100:00100000:0.0:1788869681.056111:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554714880 00000100:00100000:0.0:1788869681.056139:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554715392 00000100:00100000:0.0:1788869681.056142:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554715392 00000100:00100000:0.0:1788869681.056162:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554715904 00000100:00100000:0.0:1788869681.056164:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554715904 00000100:00100000:0.0:1788869681.056177:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554715008 00000100:00100000:0.0:1788869681.056179:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554715008 00000100:00100000:0.0:1788869681.056194:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788869681.056202:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554714880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869681.056491:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554714880:12345-0@lo:400:kworker.0 Request processed in 290us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869681.056499:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788869681.056516:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788869681.056523:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554715392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869681.056546:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554715392:12345-0@lo:400:kworker.0 Request processed in 25us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869681.056552:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788869681.056561:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788869681.056567:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875765554715904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869681.056589:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875765554715904:12345-0@lo:400:kworker.0 Request processed in 22us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869681.056601:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788869681.056611:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788869681.056616:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554715008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869681.056640:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554715008:12345-0@lo:400:kworker.0 Request processed in 24us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869681.056645:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788869681.056663:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554715520 00000100:00100000:0.0:1788869681.056667:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554715520 00000100:00100000:0.0:1788869681.056691:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788869681.056696:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554715520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869681.056723:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554715520:12345-0@lo:400:kworker.0 Request processed in 27us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869681.056728:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788869681.056762:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554715008:0@lo:400:kworker.0 00000100:00100000:0.0:1788869681.056773:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554715520:0@lo:400:kworker.0 00000100:00100000:0.0:1788869681.056780:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554714880:0@lo:400:kworker.0 00010000:00080000:0.0:1788869681.056791:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8397fb80 x1875765554715392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869681.056801:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554715392:0@lo:400:kworker.0 00010000:00080000:0.0:1788869681.056809:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ff832e3480 x1875765554715904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869681.056817:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff832e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875765554715904:0@lo:400:kworker.0 00000100:00100000:3.0:1788869681.060878:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554714752:0@lo:400:kworker.0 00000100:00100000:3.0:1788869681.060967:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869681.061033:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875765554715264:0@lo:400:kworker.0 00000100:00100000:3.0:1788869681.061065:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869681.061089:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff832e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1875765554715776:0@lo:400:kworker.0 00000100:00100000:3.0:1788869681.061111:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869681.061139:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788869681.061162:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554715136:0@lo:400:kworker.0 00000100:00100000:3.0:1788869681.061205:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869681.061227:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff832e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554715648:0@lo:400:kworker.0 00000100:00100000:3.0:1788869681.061249:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869681.061336:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554715264 00000100:00100000:3.0:1788869681.061345:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554715264 00000100:00100000:3.0:1788869681.061397:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554715776 00000100:00100000:3.0:1788869681.061400:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554715776 00000100:00100000:3.0:1788869681.061427:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788869681.061436:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875765554715264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869681.062354:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554714752 00000100:00100000:0.0:1788869681.062391:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554714752 00000100:00100000:0.0:1788869681.062439:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1788869681.062461:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554714752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869681.062529:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554714752:12345-0@lo:400:kworker.0 Request processed in 70us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869681.062536:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1788869681.063685:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788869681.063701:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875765554715776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869681.063757:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875765554715776:12345-0@lo:400:kworker.0 Request processed in 63us (2645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869681.063765:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:0.0:1788869681.063789:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869681.063795:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788869681.063798:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869681.065349:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554715136 00000100:00100000:0.0:1788869681.065361:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554715136 00000100:00100000:0.0:1788869681.065748:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788869681.065759:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554715136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869681.065837:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554715136:12345-0@lo:400:kworker.0 Request processed in 80us (4631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869681.065844:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788869681.067328:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554715648 00000100:00100000:3.0:1788869681.067339:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554715648 00000100:00100000:3.0:1788869681.067433:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788869681.067686:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875765554715648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869681.067774:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875765554715648:12345-0@lo:400:kworker.0 Request processed in 333us (6522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869681.067782:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788869681.067853:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554715136:0@lo:400:kworker.0 00000100:00100000:3.0:1788869681.067871:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff832e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554715648:0@lo:400:kworker.0 00000100:00100000:3.0:1788869681.067885:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554714752:0@lo:400:kworker.0 00000100:00100000:3.0:1788869681.067974:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff832e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1875765554715776:0@lo:400:kworker.0 00000100:00100000:3.0:1788869681.068062:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875765554715264:12345-0@lo:400:kworker.0 Request processed in 6625us (6994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869681.068071:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788869681.068103:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875765554715264:0@lo:400:kworker.0 00000100:00080000:0.0:1788869681.068199:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869681.100872:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869681.100925:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545209856 00000100:00100000:3.0:1788869681.100935:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545209856 00000100:00100000:3.0:1788869681.100988:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:3.0:1788869681.100998:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+24:11392:x1875765545209856:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788869681.101381:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+25:11392:x1875765545209856:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 382us (517us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788869681.101400:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 34 00010000:00010000:2.0:1788869681.177297:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869682.200584:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869682.820765:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869682.825369:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869682.825425:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869682.825569:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545210368 00000100:00100000:2.0:1788869682.825583:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545210368 00000100:00100000:2.0:1788869682.825654:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 118 00000100:00100000:2.0:1788869682.825661:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf4fff62-1855-4361-a244-1a23eb291d37+6:2388:x1875765545210368:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869682.825740:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf4fff62-1855-4361-a244-1a23eb291d37+6:2388:x1875765545210368:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 80us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869682.825746:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 118 00000100:00080000:2.0:1788869682.826119:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869682.832725:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869682.832761:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869682.837054:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545210112 00000100:00100000:1.0:1788869682.837073:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545210112 00000100:00100000:1.0:1788869682.837229:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545210624 00000100:00100000:1.0:1788869682.837234:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545210624 00000100:00100000:1.0:1788869682.837308:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 298 00000100:00100000:1.0:1788869682.837321:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+25:2388:x1875765545210112:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869682.837459:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+25:2388:x1875765545210112:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 140us (16709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869682.837468:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 298 00000100:00100000:1.0:1788869682.837488:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 299 00000100:00100000:1.0:1788869682.837496:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2388:x1875765545210624:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869682.837523:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2388:x1875765545210624:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (12098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869682.837530:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 299 00000100:00100000:1.0:1788869682.837725:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545209984 00000100:00100000:1.0:1788869682.837731:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545209984 00000100:00100000:1.0:1788869682.837762:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 382 00000100:00100000:1.0:1788869682.837768:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2388:x1875765545209984:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869682.837806:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2388:x1875765545209984:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 38us (5096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869682.837814:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 382 00000100:00080000:1.0:1788869682.838433:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869682.840499:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869682.840531:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869682.841510:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545210240 00000100:00100000:3.0:1788869682.844981:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545210240 00000100:00100000:3.0:1788869682.845116:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545210752 00000100:00100000:3.0:1788869682.845121:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545210752 00000100:00100000:3.0:1788869682.845162:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 300 00000100:00100000:3.0:1788869682.845174:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2388:x1875765545210240:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869682.845919:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 301 00000100:00100000:1.0:1788869682.845933:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2388:x1875765545210752:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869682.846038:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2388:x1875765545210752:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 109us (5505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869682.846064:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 301 00000100:00080000:0.0:1788869682.846506:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869682.847552:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545210496 00000100:00100000:0.0:1788869682.847565:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545210496 00000100:00100000:0.0:1788869682.847632:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 119 00000100:00100000:0.0:1788869682.847645:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2388:x1875765545210496:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869682.847711:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2388:x1875765545210496:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 71us (7224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869682.847718:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 119 00000100:00080000:0.0:1788869682.847741:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869682.857747:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2388:x1875765545210240:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 12552us (24960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869682.857768:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 300 00000004:00080000:1.0:1788869683.097438:0:8523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 301024181146ns, next at 302024176601ns, rc = 0 00000100:00100000:0.0:1788869683.097592:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869683.097622:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff89f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554716032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869683.097721:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869683.098153:0:13961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554716032 00000100:00100000:3.0:1788869683.098164:0:13961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554716032 00000100:00100000:3.0:1788869683.098247:0:13961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788869683.098287:0:13961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1875765554716032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869683.098328:0:13961:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788869683.098388:0:13961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1875765554716032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869683.098396:0:13961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1788869683.098502:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869683.098564:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff89f7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554716160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869683.098602:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869683.098735:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554716160 00000100:00100000:1.0:1788869683.098740:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554716160 00000100:00100000:1.0:1788869683.098777:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788869683.098784:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554716160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869683.098796:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788869683.098839:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554716160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869683.098846:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788869683.098969:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff89f7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554716160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869683.099226:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff89f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554716032:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788869683.099325:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788869683.224406:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788869683.403812:0:14274:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788869683.403821:0:14274:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788869683.403863:0:14274:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788869683.403869:0:14274:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788869683.593499:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869683.593538:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545211008 00000100:00100000:0.0:1788869683.593548:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545211008 00000100:00100000:0.0:1788869683.594132:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 145 00000100:00100000:0.0:1788869683.594144:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+25:11414:x1875765545211008:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1788869683.594164:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869683.594189:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc35d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaabc7 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869683.596536:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05600/0xbead52e175fc35dc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869683.596579:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05600/0xbead52e175fc35dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869683.596592:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05600/0xbead52e175fc35dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869683.596607:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788869683.596721:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc35d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabc7 expref: 28 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869683.596738:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05600/0xbead52e175fc35dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabc7 expref: 27 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869683.596747:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:0.0:1788869683.596750:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788869683.596754:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb05600, rc 0) 00000100:00100000:0.0:1788869683.596826:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+27:11414:x1875765545211008:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 2684us (3336us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788869683.596834:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 145 00000100:00080000:2.0:1788869683.598367:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869683.608812:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869683.609797:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545211136 00000100:00100000:3.0:1788869683.609810:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545211136 00000100:00100000:3.0:1788869683.609879:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 146 00000100:00100000:3.0:1788869683.609890:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+27:11414:x1875765545211136:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:3.0:1788869683.609963:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc35ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869683.609982:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc35ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869683.609993:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc35ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869683.610031:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc35ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869683.610038:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc35ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869683.610045:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc35ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869683.610051:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869683.610055:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc35ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869683.610062:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc35ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869683.610086:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:3.0:1788869683.610089:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869683.610093:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc35ea lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869683.610099:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc35ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869683.610175:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+27:11414:x1875765545211136:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 287us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869683.610182:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 146 00000100:00100000:3.0:1788869683.612692:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869683.612713:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554716288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869683.612778:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869683.612831:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554716288 00000100:00100000:3.0:1788869683.612838:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554716288 00000100:00100000:3.0:1788869683.612881:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788869683.612889:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554716288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869683.612923:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788869683.612966:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554716288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869683.612973:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788869683.613014:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554716288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869683.729478:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869683.729768:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545211264 00000100:00100000:2.0:1788869683.729778:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545211264 00000100:00100000:2.0:1788869683.729846:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:2.0:1788869683.729857:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf4fff62-1855-4361-a244-1a23eb291d37+6:2389:x1875765545211264:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:2.0:1788869683.729878:0:8527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869683.729898:0:8527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a9ba5c/0xbead52e175fc35f1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaabce expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788869683.729928:0:8527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ffc30, atime: 0x6a9ffc30, ctime: 0x6a9ffc30, blocks: 0x8 00010000:00010000:2.0:1788869683.729950:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=301s v=(0 0) 00010000:00010000:2.0:1788869683.729955:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869683.729964:0:8527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a9ba5c/0xbead52e175fc35f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabce expref: 7 pid: 8527 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869683.729984:0:8527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000072a9ba5c/0xbead52e175fc35f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabce expref: 7 pid: 8527 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869683.729998:0:8527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1200, rc 0) 00000100:00100000:2.0:1788869683.730067:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bf4fff62-1855-4361-a244-1a23eb291d37+7:2389:x1875765545211264:12345-192.168.201.30@tcp:101:cat.0 Request processed in 211us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869683.730074:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:3.0:1788869683.735145:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869683.735312:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545211392 00000100:00100000:1.0:1788869683.735322:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545211392 00002000:00100000:1.0:1788869683.735382:0:8406:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff99ffbfb44700 x1875765545211392/t0(0) o3->bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp:629/0 lens 488/0 e 0 to 0 dl 1788869694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788869683.735401:0:8406:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffbfb44700 with x1875765545211392 ext(0->4095) 00002000:00010000:1.0:1788869683.735406:0:8406:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffbfb44700 00000100:00100000:1.0:1788869683.735446:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:1.0:1788869683.735457:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf4fff62-1855-4361-a244-1a23eb291d37+7:2388:x1875765545211392:12345-192.168.201.30@tcp:3:cat.0 00000100:00100000:1.0:1788869683.735631:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf4fff62-1855-4361-a244-1a23eb291d37+7:2388:x1875765545211392:12345-192.168.201.30@tcp:3:cat.0 Request processed in 176us (494us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788869683.735638:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00002000:00100000:1.0:1788869683.735659:0:8406:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff99ffbfb44700 x1875765545211392/t0(0) o3->bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp:629/0 lens 488/4536 e 0 to 0 dl 1788869694 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788869683.735666:0:8406:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffbfb44700 with x1875765545211392 ext(0->4095) 00002000:00010000:1.0:1788869683.735669:0:8406:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffbfb44700 00010000:00010000:2.0:1788869684.248655:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788869685.158663:0:9476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:3.0:1788869685.272400:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869685.656465:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554716416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869685.656539:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869685.656657:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554716416 00000100:00100000:0.0:1788869685.656665:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554716416 00000100:00100000:0.0:1788869685.656722:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788869685.656730:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf901c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554716416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869685.656757:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869685.656797:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf901c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554716416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869685.656811:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788869685.656843:0:3618:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1788869685.656848:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1788869685.656864:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffbfb45c00, transno 4294967305 00000100:00100000:0.0:1788869685.656880:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554716416:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788869685.657097:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869685.657571:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8335e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554716544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869685.657607:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869685.657673:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554716544 00000100:00100000:3.0:1788869685.657677:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554716544 00000100:00100000:3.0:1788869685.657709:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788869685.657715:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554716544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869685.657739:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788869685.657771:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554716544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869685.657776:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788869685.657833:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8335e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554716544:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1788869685.660017:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000004:00080000:1.0:1788869685.660027:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788869685.660053:0:6463:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ffb95adcc0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788869685.660057:0:6463:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99ffbfb40a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ffb95ad240 00000020:00080000:1.0:1788869685.660059:0:6463:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99ffbfb40300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fe838d6400 00000020:00080000:1.0:1788869685.660071:0:6463:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:0.0:1788869685.660109:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc356c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869685.660118:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc356c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869685.660124:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc356c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869685.660127:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869685.660131:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc356c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869685.660137:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc356c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869685.660153:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99fe821d6c00) 00010000:00010000:0.0:1788869685.660155:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869685.660158:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc356c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869685.660162:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc356c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788869685.660184:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788869685.660248:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1788869685.660426:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869685.660443:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8335e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554716672:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788869685.660508:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869685.660584:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554716672 00000100:00100000:3.0:1788869685.660592:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554716672 00000100:00100000:3.0:1788869685.660644:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788869685.660653:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1875765554716672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788869685.660764:0:8400:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788869685.660768:0:8400:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1788869680 -> 1788869680 00002000:00010000:3.0:1788869685.660771:0:8400:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1788869680 -> 1788869680 00002000:00010000:3.0:1788869685.660773:0:8400:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788869680 -> 1788869680 00002000:00010000:3.0:1788869685.660775:0:8400:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788869685.660811:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3617:x1875765554716672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 159us (302us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788869685.660818:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:3.0:1788869685.660978:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fe8335e300/2, rc 0, transno 4294967313 00000100:00100000:3.0:1788869685.660982:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8335e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554716672:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1788869685.661015:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788869685.665470:0:8393:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1788869685.665486:0:8393:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:0.0:1788869686.168483:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869686.168501:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554716800:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869686.168558:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869686.168650:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554716800 00000100:00100000:3.0:1788869686.168670:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554716800 00000100:00100000:3.0:1788869686.168719:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788869686.168725:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554716800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869686.168744:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869686.168779:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554716800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869686.168784:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788869686.168874:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554717184:0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.168894:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869686.168906:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554717696:0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.168920:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869686.168929:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554718208:0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.168941:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869686.168964:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554716800:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869686.168980:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788869686.168983:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554717312:0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.168996:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869686.169008:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554717824:0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169020:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869686.169028:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554718336:0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169038:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869686.169054:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554717184 00000100:00100000:3.0:1788869686.169057:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554717184 00000100:00100000:3.0:1788869686.169073:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788869686.169077:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554717184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169110:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554717184:12345-0@lo:400:kworker.0 Request processed in 32us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869686.169124:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788869686.169137:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554717696 00000100:00100000:3.0:1788869686.169140:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554717696 00000100:00100000:3.0:1788869686.169155:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554718208 00000100:00100000:3.0:1788869686.169157:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554718208 00000100:00100000:3.0:1788869686.169165:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554717312 00000100:00100000:3.0:1788869686.169166:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554717312 00000100:00100000:3.0:1788869686.169174:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788869686.169177:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554717696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169196:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554717696:12345-0@lo:400:kworker.0 Request processed in 19us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869686.169199:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788869686.169206:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788869686.169209:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554718208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169222:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554718208:12345-0@lo:400:kworker.0 Request processed in 13us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869686.169226:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788869686.169231:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788869686.169234:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554717312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169247:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554717312:12345-0@lo:400:kworker.0 Request processed in 13us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869686.169269:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788869686.169280:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554717824 00000100:00100000:3.0:1788869686.169282:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554717824 00000100:00100000:3.0:1788869686.169302:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554718336 00000100:00100000:3.0:1788869686.169312:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554718336 00000100:00100000:3.0:1788869686.169330:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788869686.169335:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554717824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169363:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554717824:12345-0@lo:400:kworker.0 Request processed in 28us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869686.169369:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788869686.169380:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788869686.169385:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554718336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169409:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554718336:12345-0@lo:400:kworker.0 Request processed in 24us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869686.169414:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788869686.169450:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554716928:0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169478:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869686.169498:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554717440:0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169517:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869686.169532:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554717952:0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169550:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869686.169566:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788869686.169572:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554717056:0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169588:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869686.169597:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554717568:0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169609:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869686.169616:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554718080:0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169626:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869686.169637:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554717056 00000100:00100000:3.0:1788869686.169643:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554717056 00000100:00100000:3.0:1788869686.169656:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554717568 00000100:00100000:3.0:1788869686.169657:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554717568 00000100:00100000:3.0:1788869686.169664:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554718080 00000100:00100000:3.0:1788869686.169665:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554718080 00000100:00100000:3.0:1788869686.169673:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788869686.169676:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554717056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169697:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554717056:12345-0@lo:400:kworker.0 Request processed in 21us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869686.169701:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788869686.169707:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788869686.169710:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554717568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169724:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554717568:12345-0@lo:400:kworker.0 Request processed in 14us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869686.169727:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788869686.169732:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788869686.169735:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554718080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169747:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554718080:12345-0@lo:400:kworker.0 Request processed in 11us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869686.169750:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788869686.169759:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554717952 00000100:00100000:3.0:1788869686.169761:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554717952 00000100:00100000:3.0:1788869686.169771:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788869686.169775:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554717952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169788:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554717952:12345-0@lo:400:kworker.0 Request processed in 14us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869686.169792:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788869686.169816:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554717312:0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169822:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554717824:0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169827:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554718336:0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169832:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554717184:0@lo:400:kworker.0 00010000:00080000:3.0:1788869686.169840:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839bce00 x1875765554717696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869686.169846:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554717696:0@lo:400:kworker.0 00010000:00080000:3.0:1788869686.169852:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfa61500 x1875765554718208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869686.169857:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554718208:0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169875:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554717056:0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169879:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554717568:0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169884:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554718080:0@lo:400:kworker.0 00000100:00100000:3.0:1788869686.169888:0:3618:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1788869686.169892:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967313 00000004:00080000:3.0:1788869686.169903:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fe8335e300, transno 4294967313 00000100:00100000:3.0:1788869686.169909:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554717952:0@lo:400:kworker.0 00000100:00100000:0.0:1788869686.170065:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554716928 00000100:00100000:0.0:1788869686.170067:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554716928 00000100:00100000:0.0:1788869686.170093:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788869686.170097:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554716928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869686.170124:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554716928:12345-0@lo:400:kworker.0 Request processed in 27us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869686.170128:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00080000:0.0:1788869686.170147:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869686.170150:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788869686.170151:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869686.170153:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869686.170164:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554716928:0@lo:400:kworker.0 00000100:00100000:1.0:1788869686.171173:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554717440 00000100:00100000:1.0:1788869686.171179:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554717440 00000040:00080000:3.0:1788869686.171309:0:13761:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788869686.171313:0:13761:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788869686.171332:0:13761:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788869686.171338:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788869686.171414:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788869686.171432:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554717440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869686.171501:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554717440:12345-0@lo:400:kworker.0 Request processed in 71us (1982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869686.171506:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788869686.171568:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554717440:0@lo:400:kworker.0 00010000:00010000:1.0:1788869686.297393:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788869686.489954:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788869687.320443:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869687.914471:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869687.914509:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869687.914543:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869687.914584:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869687.914603:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869687.914624:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869687.914647:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869687.914681:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545211776 00000100:00100000:0.0:1788869687.914691:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545211776 00000100:00100000:0.0:1788869687.914747:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545212288 00000100:00100000:0.0:1788869687.914763:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545212288 00000100:00100000:0.0:1788869687.914783:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545211648 00000100:00100000:0.0:1788869687.914785:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545211648 00000100:00100000:0.0:1788869687.914797:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545212160 00000100:00100000:0.0:1788869687.914799:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545212160 00000100:00100000:0.0:1788869687.914815:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 308 00000100:00100000:0.0:1788869687.914824:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545211776:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869687.914906:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545211776:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 82us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869687.914914:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 308 00000100:00100000:0.0:1788869687.914932:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 309 00000100:00100000:0.0:1788869687.914939:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545212288:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869687.914964:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545212288:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869687.914969:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 309 00000100:00100000:0.0:1788869687.914981:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 310 00000100:00100000:0.0:1788869687.914987:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+13:2387:x1875765545211648:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869687.915011:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+13:2387:x1875765545211648:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869687.915018:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 310 00000100:00100000:0.0:1788869687.915029:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 311 00000100:00100000:0.0:1788869687.915036:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545212160:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869687.915058:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545212160:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869687.915064:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 311 00000100:00080000:0.0:1788869687.915093:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869687.915098:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869687.915300:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545212032 00000100:00100000:3.0:1788869687.915306:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545212032 00000100:00100000:3.0:1788869687.915356:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545211904 00000100:00100000:3.0:1788869687.915360:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545211904 00000100:00100000:3.0:1788869687.915381:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 123 00000100:00100000:3.0:1788869687.915388:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545212032:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869687.915417:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545212032:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 30us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869687.915433:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 123 00000100:00100000:3.0:1788869687.915446:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 124 00000100:00100000:3.0:1788869687.915453:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2387:x1875765545211904:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869687.915478:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2387:x1875765545211904:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869687.915483:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 124 00000100:00100000:1.0:1788869687.915862:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545211520 00000100:00100000:1.0:1788869687.915867:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545211520 00000100:00100000:1.0:1788869687.915912:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 384 00000100:00100000:1.0:1788869687.915920:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2387:x1875765545211520:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869687.915961:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2387:x1875765545211520:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 42us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869687.915968:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 384 00000100:00080000:0.0:1788869687.917437:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788869687.917446:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869688.216740:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869688.216763:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554718592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869688.216834:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869688.217297:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869688.217310:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff89f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554718464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869688.217342:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869688.217434:0:13961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554718592 00000100:00100000:3.0:1788869688.217443:0:13961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554718592 00000100:00100000:3.0:1788869688.217500:0:13961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554718464 00000100:00100000:3.0:1788869688.217503:0:13961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554718464 00000100:00100000:3.0:1788869688.217532:0:13961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788869688.217541:0:13961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554718592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869688.217571:0:13961:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788869688.217618:0:13961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554718592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869688.217625:0:13961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788869688.217641:0:13961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788869688.217647:0:13961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554718464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869688.217666:0:13961:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788869688.217694:0:13961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554718464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869688.217700:0:13961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788869688.217855:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554718592:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788869688.217982:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869688.218005:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff89f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554718464:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788869688.348876:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869688.728649:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869688.728678:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554718720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869688.728753:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869688.729402:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554718720 00000100:00100000:3.0:1788869688.729412:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554718720 00000100:00100000:3.0:1788869688.729477:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788869688.729487:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554718720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869688.729527:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788869688.729588:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554718720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869688.729595:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788869688.729641:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554718720:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869689.127105:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869689.127232:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545212416 00000100:00100000:2.0:1788869689.127242:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545212416 00000100:00080000:1.0:1788869689.127439:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869689.127498:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 147 00000100:00100000:2.0:1788869689.127509:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+13:11067:x1875765545212416:12345-192.168.201.30@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788869689.127656:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+13:11067:x1875765545212416:12345-192.168.201.30@tcp:60:lhsmtool_posix.0 Request processed in 149us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869689.127664:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 147 00000100:00100000:3.0:1788869689.133009:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869689.133113:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545212544 00000100:00100000:0.0:1788869689.133123:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545212544 00000100:00080000:1.0:1788869689.133196:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869689.133199:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 148 00000100:00100000:0.0:1788869689.133210:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:11067:x1875765545212544:12345-192.168.201.30@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788869689.133347:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:11067:x1875765545212544:12345-192.168.201.30@tcp:60:lhsmtool_posix.0 Request processed in 138us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869689.133354:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 148 00000100:00100000:3.0:1788869689.135362:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869689.135474:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545212800 00000100:00100000:0.0:1788869689.135483:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545212800 00000100:00100000:0.0:1788869689.135536:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:0.0:1788869689.135546:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+13:11067:x1875765545212800:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788869689.135797:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+14:11067:x1875765545212800:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 251us (442us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788869689.135806:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:2.0:1788869689.364691:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869689.364778:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545212928 00000100:00100000:3.0:1788869689.364787:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545212928 00000100:00100000:3.0:1788869689.364867:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 149 00000100:00100000:3.0:1788869689.364878:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+5:11872:x1875765545212928:12345-192.168.201.30@tcp:101:lsof.0 00010000:00010000:3.0:1788869689.364901:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869689.364923:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc35f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaabd5 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869689.364995:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc35ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869689.365030:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc35ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869689.365042:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc35ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869689.365101:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788869689.365105:0:9496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869689.365141:0:9496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc35ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869689.365169:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc35f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabd5 expref: 7 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869689.365188:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc35ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabd5 expref: 6 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869689.365195:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff88bbf300) 00010000:00010000:3.0:1788869689.365198:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869689.365202:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81535400, rc 0) 00000100:00080000:1.0:1788869689.365331:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869689.365573:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+6:11872:x1875765545212928:12345-192.168.201.30@tcp:101:lsof.0 Request processed in 695us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869689.365582:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 149 00010000:00010000:1.0:1788869689.368714:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869690.392495:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869690.776650:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554718848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869690.776747:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869690.776884:0:13961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554718848 00000100:00100000:2.0:1788869690.776894:0:13961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554718848 00000100:00100000:2.0:1788869690.776968:0:13961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788869690.776979:0:13961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554718848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869690.777016:0:13961:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869690.777067:0:13961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554718848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869690.777076:0:13961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788869690.777111:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554718848:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788869690.777303:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869690.777903:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554718976:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869690.777971:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869690.778094:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554718976 00000100:00100000:2.0:1788869690.778100:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554718976 00000100:00100000:2.0:1788869690.778146:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788869690.778165:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554718976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869690.778196:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788869690.778240:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554718976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869690.778246:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788869690.778354:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554718976:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869691.288657:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554719360:0@lo:400:kworker.0 00000100:00100000:3.0:1788869691.288735:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869691.288794:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554719872:0@lo:400:kworker.0 00000100:00100000:3.0:1788869691.288830:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869691.288848:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554720384:0@lo:400:kworker.0 00000100:00100000:3.0:1788869691.288865:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869691.288886:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788869691.288892:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875765554719232:0@lo:400:kworker.0 00000100:00100000:3.0:1788869691.288911:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869691.288928:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875765554719744:0@lo:400:kworker.0 00000100:00100000:3.0:1788869691.288948:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869691.288970:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1875765554720256:0@lo:400:kworker.0 00000100:00100000:3.0:1788869691.288988:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869691.289016:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554719360 00000100:00100000:3.0:1788869691.289023:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554719360 00000100:00100000:3.0:1788869691.289068:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788869691.289078:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554719360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869691.289134:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554719360:12345-0@lo:400:kworker.0 Request processed in 57us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869691.289141:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788869691.289165:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554719872 00000100:00100000:3.0:1788869691.289168:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554719872 00000100:00100000:3.0:1788869691.289195:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554720384 00000100:00100000:3.0:1788869691.289198:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554720384 00000100:00100000:3.0:1788869691.289209:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554719232 00000100:00100000:3.0:1788869691.289211:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554719232 00000100:00100000:3.0:1788869691.289238:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554719744 00000100:00100000:3.0:1788869691.289241:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554719744 00000100:00100000:3.0:1788869691.289283:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554720256 00000100:00100000:3.0:1788869691.289286:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554720256 00000100:00100000:3.0:1788869691.289303:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788869691.289318:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554719872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869691.289351:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554719872:12345-0@lo:400:kworker.0 Request processed in 35us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869691.289357:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788869691.289369:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788869691.289375:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875765554720384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869691.289401:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875765554720384:12345-0@lo:400:kworker.0 Request processed in 26us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869691.289406:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788869691.289417:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788869691.289423:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875765554719232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869691.289459:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875765554719232:12345-0@lo:400:kworker.0 Request processed in 36us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869691.289465:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788869691.289477:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788869691.289482:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875765554719744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869691.289504:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875765554719744:12345-0@lo:400:kworker.0 Request processed in 22us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869691.289509:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788869691.289518:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788869691.289524:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875765554720256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869691.289548:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875765554720256:12345-0@lo:400:kworker.0 Request processed in 24us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869691.289552:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788869691.289604:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875765554719232:0@lo:400:kworker.0 00000100:00100000:3.0:1788869691.289623:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875765554719744:0@lo:400:kworker.0 00000100:00100000:3.0:1788869691.289631:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1875765554720256:0@lo:400:kworker.0 00000100:00100000:3.0:1788869691.289639:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554719360:0@lo:400:kworker.0 00010000:00080000:3.0:1788869691.289650:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839be680 x1875765554719872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869691.289660:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554719872:0@lo:400:kworker.0 00010000:00080000:3.0:1788869691.289668:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839bca80 x1875765554720384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869691.289675:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554720384:0@lo:400:kworker.0 00000100:00100000:0.0:1788869691.289870:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869691.289880:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8228d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554720768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869691.289916:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869691.289943:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554720768 00000100:00100000:0.0:1788869691.289946:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554720768 00000100:00100000:0.0:1788869691.289979:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788869691.289986:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffba0d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554720768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869691.290002:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869691.290037:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffba0d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554720768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869691.290043:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788869691.290246:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8228d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554720768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869691.290597:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554719104:0@lo:400:kworker.0 00000100:00100000:1.0:1788869691.290638:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869691.290676:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554719616:0@lo:400:kworker.0 00000100:00100000:1.0:1788869691.290702:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869691.290731:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554720128:0@lo:400:kworker.0 00000100:00100000:1.0:1788869691.290752:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869691.290773:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8400ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554720640:0@lo:400:kworker.0 00000100:00100000:1.0:1788869691.290792:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869691.290813:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788869691.290830:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875765554719488:0@lo:400:kworker.0 00000100:00100000:1.0:1788869691.290857:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869691.290876:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554720000:0@lo:400:kworker.0 00000100:00100000:1.0:1788869691.290897:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869691.290912:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8400df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554720512:0@lo:400:kworker.0 00000100:00100000:1.0:1788869691.290931:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869691.290958:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554720128 00000100:00100000:1.0:1788869691.290963:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554720128 00000100:00100000:1.0:1788869691.290992:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554720640 00000100:00100000:1.0:1788869691.290995:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554720640 00000100:00100000:1.0:1788869691.291008:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554720000 00000100:00100000:1.0:1788869691.291010:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554720000 00000100:00100000:1.0:1788869691.291021:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554720512 00000100:00100000:1.0:1788869691.291023:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554720512 00000100:00100000:1.0:1788869691.291033:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788869691.291039:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554720128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869691.291084:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554720128:12345-0@lo:400:kworker.0 Request processed in 44us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869691.291090:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788869691.291105:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788869691.291111:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554720640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869691.291139:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554720640:12345-0@lo:400:kworker.0 Request processed in 28us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869691.291145:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788869691.291156:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788869691.291162:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554720000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869691.291188:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554720000:12345-0@lo:400:kworker.0 Request processed in 27us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869691.291201:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788869691.291213:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788869691.291219:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554720512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869691.291249:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554720512:12345-0@lo:400:kworker.0 Request processed in 30us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869691.291288:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1788869691.291308:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869691.291312:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869691.291316:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869691.291319:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869691.291342:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554720000:0@lo:400:kworker.0 00000100:00100000:1.0:1788869691.291353:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8400df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554720512:0@lo:400:kworker.0 00000100:00100000:1.0:1788869691.291361:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554720128:0@lo:400:kworker.0 00000100:00100000:1.0:1788869691.291368:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8400ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554720640:0@lo:400:kworker.0 00000100:00100000:1.0:1788869691.291393:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554719488 00000100:00100000:1.0:1788869691.291397:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554719488 00000100:00100000:1.0:1788869691.291422:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788869691.291443:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875765554719488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869691.291479:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875765554719488:12345-0@lo:400:kworker.0 Request processed in 51us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869691.291484:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788869691.291506:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875765554719488:0@lo:400:kworker.0 00000100:00100000:3.0:1788869691.291755:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554719104 00000100:00100000:3.0:1788869691.291760:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554719104 00000100:00100000:3.0:1788869691.291797:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1788869691.291804:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3619:x1875765554719104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869691.291839:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3619:x1875765554719104:12345-0@lo:400:kworker.0 Request processed in 36us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869691.291844:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1788869691.291928:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554719616 00000100:00100000:0.0:1788869691.291933:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554719616 00000100:00100000:0.0:1788869691.291963:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788869691.291969:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554719616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869691.292004:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554719616:12345-0@lo:400:kworker.0 Request processed in 35us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869691.292009:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788869691.292422:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554719104:0@lo:400:kworker.0 00000100:00100000:1.0:1788869691.292447:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554719616:0@lo:400:kworker.0 00000001:00080000:3.0:1788869691.296239:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1788869691.296287:0:6463:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788869691.296331:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788869691.296344:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788869691.419687:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869692.446234:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788869692.615134:0:14471:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:14:52 (1788869692) 00000100:00100000:1.0:1788869693.030232:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869693.030522:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545213056 00000100:00100000:2.0:1788869693.030536:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545213056 00000100:00100000:2.0:1788869693.030616:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 386 00000100:00100000:2.0:1788869693.030630:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2388:x1875765545213056:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869693.031637:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2388:x1875765545213056:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 1003us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869693.031649:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 386 00000100:00100000:0.0:1788869693.031994:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869693.032041:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869693.032069:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869693.032091:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869693.032135:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869693.032161:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545213184 00000100:00100000:2.0:1788869693.032169:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545213184 00000100:00100000:0.0:1788869693.032174:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869693.032196:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545213696 00000100:00100000:0.0:1788869693.032200:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545213696 00000100:00100000:2.0:1788869693.032221:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545213312 00000100:00100000:0.0:1788869693.032223:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 318 00000100:00100000:2.0:1788869693.032224:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545213312 00000100:00100000:0.0:1788869693.032231:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+13:2388:x1875765545213184:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869693.032237:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545213824 00000100:00100000:2.0:1788869693.032239:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545213824 00000100:00100000:2.0:1788869693.032277:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 319 00000100:00100000:2.0:1788869693.032284:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+6:2387:x1875765545213696:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869693.032365:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 320 00000100:00100000:1.0:1788869693.032375:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545213312:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869693.032610:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+13:2388:x1875765545213184:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 378us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869693.032618:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 318 00000100:00100000:0.0:1788869693.032634:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 321 00000100:00100000:0.0:1788869693.032641:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545213824:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869693.036293:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+6:2387:x1875765545213696:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 3991us (4203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869693.036293:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545213312:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 3912us (4192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869693.036313:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 319 00000100:00100000:1.0:1788869693.036319:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 320 00000100:00080000:1.0:1788869693.036373:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869693.036381:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545213440 00000100:00080000:1.0:1788869693.036381:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869693.036391:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545213440 00000100:00100000:2.0:1788869693.036991:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545213568 00000100:00100000:2.0:1788869693.036997:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545213568 00000100:00100000:0.0:1788869693.038661:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545213824:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 6005us (6482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869693.038676:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 321 00000100:00100000:0.0:1788869693.038742:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 129 00000100:00100000:0.0:1788869693.038757:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8228e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:2387:x1875765545213440:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869693.038833:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8228e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:2387:x1875765545213440:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 81us (6791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869693.038841:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 129 00000100:00080000:1.0:1788869693.039160:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869693.039168:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869693.039305:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 130 00000100:00100000:2.0:1788869693.039316:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545213568:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869693.039351:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545213568:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 37us (7215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869693.039357:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 130 00000100:00100000:0.0:1788869693.337145:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8400f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554720896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869693.337293:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869693.338095:0:13961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554720896 00000100:00100000:2.0:1788869693.338107:0:13961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554720896 00000100:00100000:1.0:1788869693.338335:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554721024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869693.338382:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869693.339353:0:13961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554721024 00000100:00100000:2.0:1788869693.339362:0:13961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554721024 00000100:00100000:1.0:1788869693.339440:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788869693.339455:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554720896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869693.339499:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788869693.339574:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554720896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (2280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869693.339583:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788869693.339690:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8400f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554720896:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788869693.341296:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869693.341574:0:13961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788869693.341588:0:13961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554721024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869693.341615:0:13961:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788869693.341732:0:13961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554721024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (3349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869693.341739:0:13961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788869693.342137:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554721024:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788869693.464698:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869693.730903:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869693.731057:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545214080 00000100:00100000:2.0:1788869693.731072:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545214080 00000100:00100000:2.0:1788869693.731153:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 150 00000100:00100000:2.0:1788869693.731164:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9b52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+13:12139:x1875765545214080:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869693.731194:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869693.731223:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3606 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaabdc expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.731370:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc360d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.731415:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc360d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.731441:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc360d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.731461:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3614 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.731469:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3614 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.731477:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3614 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.731599:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc361b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.731609:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc361b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.731617:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc361b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869693.731628:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788869693.731922:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc360d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.731939:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc360d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.731946:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc360d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.731961:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869693.731966:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc360d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.731975:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc360d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.731990:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99ffb89e0500) 00010000:00010000:2.0:1788869693.731994:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869693.732000:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc360d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.732006:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc360d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.732022:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3614 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.732027:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3614 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.732033:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3614 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.732038:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1c00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869693.732040:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3614 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.732047:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3614 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.732065:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99ffb89e1600) 00010000:00010000:2.0:1788869693.732067:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869693.732070:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3614 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.732076:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3614 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.732603:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3606 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabdc expref: 16 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.732621:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc361b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabdc expref: 15 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869693.732629:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffb89e0700) 00010000:00010000:2.0:1788869693.732631:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869693.732634:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0200, rc 0) 00000100:00100000:2.0:1788869693.732998:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9b52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+15:12139:x1875765545214080:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 1833us (2105us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788869693.733009:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 150 00000100:00100000:3.0:1788869693.736920:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869693.737015:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545214208 00000100:00100000:0.0:1788869693.737028:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545214208 00000100:00100000:3.0:1788869693.737048:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869693.737112:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 151 00000100:00100000:0.0:1788869693.737125:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+15:12139:x1875765545214208:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788869693.737307:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+15:12139:x1875765545214208:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 Request processed in 184us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869693.737316:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 151 00000100:00100000:1.0:1788869693.737411:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545214336 00000100:00100000:1.0:1788869693.737416:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545214336 00000100:00100000:1.0:1788869693.737477:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:1.0:1788869693.737485:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+15:2388:x1875765545214336:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869693.737499:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869693.737532:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc361b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabdc expref: 15 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869693.737582:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffb89e0700) 00010000:00010000:1.0:1788869693.737588:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869693.737611:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+14:2388:x1875765545214336:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 127us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869693.737619:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:0.0:1788869693.741653:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869693.741764:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545214464 00000100:00100000:2.0:1788869693.741779:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545214464 00000100:00100000:2.0:1788869693.741869:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 152 00000100:00100000:2.0:1788869693.741882:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:12139:x1875765545214464:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788869693.742038:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:12139:x1875765545214464:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 Request processed in 158us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869693.742047:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 152 00000100:00100000:2.0:1788869693.848894:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869693.851803:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554721152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869693.851915:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869693.857347:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554721152 00000100:00100000:0.0:1788869693.857370:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554721152 00000100:00100000:0.0:1788869693.859747:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788869693.859772:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554721152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869693.859838:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788869693.859970:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554721152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 207us (8054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869693.859978:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788869693.861684:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554721152:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788869694.360703:0:13761:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788869694.360717:0:13761:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788869694.363057:0:13761:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788869694.363084:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788869694.490122:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869694.754801:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788869695.512491:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869695.552207:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869695.552292:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545214592 00000100:00100000:1.0:1788869695.552302:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545214592 00000100:00080000:3.0:1788869695.552346:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869695.552373:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 153 00000100:00100000:1.0:1788869695.552385:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+14:12181:x1875765545214592:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1788869695.552404:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869695.552426:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3629 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaabe3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869695.552506:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3630 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869695.552521:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3630 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869695.552532:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3630 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869695.552548:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3637 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869695.552554:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869695.552570:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869695.552612:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3630 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869695.552619:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3630 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869695.552626:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3630 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869695.552632:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80030a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869695.552637:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3630 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869695.552644:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3630 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869695.552669:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff88bbf300) 00010000:00010000:1.0:1788869695.552673:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869695.552677:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3630 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869695.552682:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3630 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869695.552693:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869695.552699:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3637 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869695.552709:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3637 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869695.552714:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80030000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869695.552717:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3637 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869695.552722:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3637 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869695.552729:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99fe831e6d00) 00010000:00010000:1.0:1788869695.552731:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869695.552734:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3637 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869695.552740:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3637 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869695.552771:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3629 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabe3 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869695.552780:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff88bbf300) 00010000:00010000:1.0:1788869695.552782:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869695.552785:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3629 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabe3 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869695.552794:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80030c00, rc 0) 00000100:00100000:1.0:1788869695.552856:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+14:12181:x1875765545214592:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 474us (658us total) trans 0 rc 301/301 00000100:00100000:1.0:1788869695.552871:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 153 00000100:00100000:3.0:1788869695.558670:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869695.558758:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545214848 00000100:00100000:2.0:1788869695.558771:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545214848 00000100:00100000:2.0:1788869695.558851:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 154 00000100:00100000:2.0:1788869695.558862:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+14:12181:x1875765545214848:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:2.0:1788869695.558947:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869695.558975:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc2f7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa07 expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.558993:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff88bbf300) 00010000:00010000:2.0:1788869695.558997:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869695.559063:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc363e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.559079:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc35ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabd5 expref: 5 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.559089:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc363e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.559125:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc35ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabd5 expref: 5 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.559137:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc35ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabd5 expref: 5 pid: 9496 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869695.559178:0:6486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe838ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6486:1875765554721280:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788869695.559297:0:6486:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff87384840 going to sleep for 11 seconds 00000100:00100000:3.0:1788869695.561524:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869695.561556:0:6486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe838ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6486:1875765554721280:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869695.561559:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545214976 00000100:00100000:3.0:1788869695.561568:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545214976 00010000:00010000:2.0:1788869695.561587:0:6486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc363e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869695.561616:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc35ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabd5 expref: 6 pid: 9496 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869695.561661:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00100000:3.0:1788869695.561671:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+6:2388:x1875765545214976:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869695.561684:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869695.561692:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc35ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabd5 expref: 6 pid: 9496 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869695.561705:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc35ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabd5 expref: 6 pid: 9496 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869695.561726:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc35ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabd5 expref: 6 pid: 9496 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869695.561739:0:9488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff88bbf300) 00010000:00010000:3.0:1788869695.561744:0:9488:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc363e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869695.561753:0:9488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc363e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869695.561761:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc363e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869695.561787:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869695.561852:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2388:x1875765545214976:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 183us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869695.561860:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00080000:3.0:1788869695.561882:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788869695.562639:0:6486:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc363e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.562649:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc363e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.562676:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3645 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.562685:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3645 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.562695:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3645 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.563245:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc364c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.563292:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc364c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.563300:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc364c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869695.563328:0:6486:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002a564fc0 reply state 00000000934c25b1 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc364c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.563339:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc364c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.563346:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:2.0:1788869695.563349:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788869695.563352:0:6486:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788869695.563358:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788869695.563365:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc363e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.563372:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc363e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.563379:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc363e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.563384:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1c00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869695.563388:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc363e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.563395:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc363e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.563404:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff88bbf300) 00010000:00010000:2.0:1788869695.563407:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869695.563410:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc363e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.563427:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc363e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869695.563465:0:6486:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002a564fc0 reply state 00000000934c25b1 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3645 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.563474:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3645 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.563479:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99ffb89e1900) 00010000:00010000:2.0:1788869695.563482:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788869695.563484:0:6486:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788869695.563547:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+15:12181:x1875765545214848:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 4684us (4885us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788869695.563554:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 154 00000100:00100000:1.0:1788869695.655542:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869695.655613:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545215104 00000100:00100000:3.0:1788869695.655624:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545215104 00000100:00100000:3.0:1788869695.655719:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 155 00000100:00100000:3.0:1788869695.655730:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+15:12189:x1875765545215104:12345-192.168.201.30@tcp:101:lctl.0 00010000:00010000:3.0:1788869695.655759:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869695.655783:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3653 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaabea expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869695.655855:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc365a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869695.655870:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc365a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869695.655883:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc365a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869695.655925:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788869695.655929:0:12967:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869695.655949:0:12967:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc365a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869695.655975:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3653 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabea expref: 17 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869695.655992:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc365a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabea expref: 16 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869695.656015:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff88bbf700) 00010000:00010000:3.0:1788869695.656018:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869695.656021:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81535a00, rc 0) 00000100:00100000:3.0:1788869695.656084:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+16:12189:x1875765545215104:12345-192.168.201.30@tcp:101:lctl.0 Request processed in 356us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869695.656092:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 155 00000100:00100000:1.0:1788869695.767924:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869695.768045:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545215232 00000100:00100000:0.0:1788869695.768056:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545215232 00000100:00100000:0.0:1788869695.768121:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 156 00000100:00100000:0.0:1788869695.768131:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+16:12195:x1875765545215232:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1788869695.768153:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869695.768174:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3661 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaabf1 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768308:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3668 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768324:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3668 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768336:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3668 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768347:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc366f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768354:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc366f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768359:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc366f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768447:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3676 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768456:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768462:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869695.768496:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788869695.768500:0:9496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869695.768520:0:9496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768545:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3668 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768551:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3668 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768558:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3668 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768564:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869695.768569:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3668 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768576:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3668 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768587:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff88bbf700) 00010000:00010000:0.0:1788869695.768590:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869695.768594:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3668 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768601:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3668 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768616:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc366f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768622:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc366f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768628:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc366f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768638:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869695.768642:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc366f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768648:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc366f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768655:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99ffb89e1900) 00010000:00010000:0.0:1788869695.768657:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869695.768660:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc366f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768666:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc366f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768693:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3661 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabf1 expref: 18 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768706:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3676 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabf1 expref: 17 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.768714:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:0.0:1788869695.768716:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788869695.768718:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb05800, rc 0) 00000100:00100000:0.0:1788869695.768774:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+17:12195:x1875765545215232:12345-192.168.201.30@tcp:101:bash.0 Request processed in 644us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869695.768781:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 156 00000100:00100000:2.0:1788869695.773078:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869695.773402:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545215488 00000100:00100000:0.0:1788869695.773426:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545215488 00000100:00100000:0.0:1788869695.773495:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 157 00000100:00100000:0.0:1788869695.773505:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+17:12195:x1875765545215488:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1788869695.773527:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869695.773550:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc367d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaabf8 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.773673:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3684 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.773689:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3684 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.773702:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3684 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.773768:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc368b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.773776:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc368b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.773783:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc368b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788869695.774119:0:6486:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788869695.774279:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc3692 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.774288:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc3692 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.774308:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc3692 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.774344:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3684 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.774351:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3684 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.774358:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3684 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.774364:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869695.774369:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3684 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.774375:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3684 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.774386:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:0.0:1788869695.774389:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869695.774393:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3684 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.774399:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc3684 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869695.774409:0:6486:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c7d80d11 reply state 000000007ca512a7 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc368b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.774418:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc368b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.774430:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99fe821d6300) 00010000:00010000:0.0:1788869695.774432:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869695.774448:0:6486:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788869695.774480:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc367d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabf8 expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.774495:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc3692 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabf8 expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.774501:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99fe821d6d00) 00010000:00010000:0.0:1788869695.774504:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869695.774506:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04c00, rc 0) 00000100:00100000:0.0:1788869695.774579:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+20:12195:x1875765545215488:12345-192.168.201.30@tcp:101:bash.0 Request processed in 1075us (1511us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1788869695.774586:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 157 00000100:00100000:1.0:1788869695.784550:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869695.784657:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545215616 00000100:00100000:0.0:1788869695.784667:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545215616 00000100:00100000:0.0:1788869695.784746:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:0.0:1788869695.784765:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:2388:x1875765545215616:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1788869695.784783:0:8399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869695.784805:0:8399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000219ca056/0xbead52e175fc36a0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaabff expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788869695.784835:0:8399:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869695.784857:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=313s v=(0 0) 00010000:00010000:0.0:1788869695.784863:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869695.784889:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000219ca056/0xbead52e175fc36a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabff expref: 6 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.784909:0:8399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000219ca056/0xbead52e175fc36a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabff expref: 6 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.784923:0:8399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04000, rc 0) 00000100:00080000:3.0:1788869695.784961:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869695.785005:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:2388:x1875765545215616:12345-192.168.201.30@tcp:101:bash.0 Request processed in 250us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869695.785013:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:3.0:1788869695.790296:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869695.791647:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545215744 00000100:00100000:2.0:1788869695.791660:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545215744 00000100:00100000:2.0:1788869695.791732:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:2.0:1788869695.791743:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+6:12195:x1875765545215744:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1788869695.791762:0:8401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869695.791782:0:8401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072d66b96/0xbead52e175fc36a7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaac06 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.791815:0:8401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000219ca056/0xbead52e175fc36a0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabff expref: 7 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.791823:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869695.791842:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869695.791847:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072d66b96/0xbead52e175fc36a7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac06 expref: 7 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.791880:0:8401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000219ca056/0xbead52e175fc36a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabff expref: 7 pid: 8399 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.791895:0:8401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000219ca056/0xbead52e175fc36a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabff expref: 7 pid: 8399 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869695.791911:0:8401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe838ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8401:1875765554721408:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788869695.792031:0:8401:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f2900 going to sleep for 11 seconds 00000100:00100000:3.0:1788869695.803582:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869695.803601:0:8401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe838ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8401:1875765554721408:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788869695.803636:0:8401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000072d66b96/0xbead52e175fc36a7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac06 expref: 7 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869695.803657:0:8401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1e00, rc 0) 00000100:00100000:2.0:1788869695.803721:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+7:12195:x1875765545215744:12345-192.168.201.30@tcp:101:bash.0 Request processed in 11980us (13471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869695.803730:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:0.0:1788869695.811581:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545215872 00000100:00100000:0.0:1788869695.811726:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545215872 00010000:00010000:0.0:1788869695.811895:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000219ca056/0xbead52e175fc36a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabff expref: 7 pid: 8399 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869695.812008:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 82 00000100:00100000:0.0:1788869695.812018:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+7:2387:x1875765545215872:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869695.812034:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869695.812059:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000219ca056/0xbead52e175fc36a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabff expref: 7 pid: 8399 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.812075:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000219ca056/0xbead52e175fc36a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabff expref: 7 pid: 8399 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.812101:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000219ca056/0xbead52e175fc36a0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabff expref: 7 pid: 8399 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.812152:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869695.812156:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869695.812166:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000072d66b96/0xbead52e175fc36a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac06 expref: 6 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.812178:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072d66b96/0xbead52e175fc36a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac06 expref: 6 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869695.812220:0:6470:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000072d66b96/0xbead52e175fc36a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac06 expref: 6 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869695.812248:0:6470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8911180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6470:1875765554721536:192.168.201.30@tcp:105: 00000100:00100000:0.0:1788869695.812402:0:6470:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff88e3e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788869695.831917:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869695.832052:0:6470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8911180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6470:1875765554721536:192.168.201.30@tcp:105: 00010000:00010000:0.0:1788869695.832075:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869695.832146:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2387:x1875765545215872:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 20129us (28572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869695.832158:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 82 00000100:00100000:3.0:1788869695.840586:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545216128 00000100:00100000:3.0:1788869695.840611:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545216128 00000100:00100000:3.0:1788869695.840686:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:3.0:1788869695.840696:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+20:12195:x1875765545216128:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:3.0:1788869695.841481:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+21:12195:x1875765545216128:12345-192.168.201.30@tcp:35:bash.0 Request processed in 784us (9571us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788869695.841491:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:1.0:1788869695.900079:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554721664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869695.900150:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869695.900200:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869695.900207:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8400d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554721792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869695.900233:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869695.900324:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554721792 00000100:00100000:3.0:1788869695.900332:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554721792 00000100:00100000:3.0:1788869695.900384:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788869695.900394:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554721792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869695.900427:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788869695.900487:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554721792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869695.900494:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788869695.900561:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554721664 00000100:00100000:0.0:1788869695.900566:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554721664 00000100:00100000:0.0:1788869695.900614:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788869695.900620:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554721664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869695.900641:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869695.900673:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554721664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869695.900691:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1788869695.900746:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869695.900822:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8400d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554721792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869695.900836:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554721664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869696.004058:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869696.004158:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545216384 00000100:00100000:3.0:1788869696.004167:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545216384 00000100:00100000:3.0:1788869696.004242:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 158 00000100:00100000:3.0:1788869696.004282:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+21:12205:x1875765545216384:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869696.004308:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869696.004331:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc36ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaac0d expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869696.004451:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788869696.004569:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc36ae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac0d expref: 23 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.004584:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff88bbf700) 00010000:00010000:3.0:1788869696.004587:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869696.004593:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc36ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac0d expref: 23 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.004609:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81535400, rc 0) 00000100:00100000:3.0:1788869696.004673:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+22:12205:x1875765545216384:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 422us (624us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1788869696.004680:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 158 00000100:00100000:2.0:1788869696.008824:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869696.009817:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545216640 00000100:00100000:3.0:1788869696.009828:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545216640 00000100:00100000:3.0:1788869696.009895:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:3.0:1788869696.009905:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+22:12205:x1875765545216640:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1788869696.010154:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+23:12205:x1875765545216640:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 250us (1339us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788869696.010176:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:1.0:1788869696.148627:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869696.148751:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545216768 00000100:00100000:3.0:1788869696.148763:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545216768 00000100:00100000:3.0:1788869696.148868:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 159 00000100:00100000:3.0:1788869696.148880:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+23:12211:x1875765545216768:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869696.148905:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869696.148925:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc36bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaac14 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.148999:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc36c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.149013:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc36c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.149025:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc36c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869696.149082:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788869696.149086:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869696.149106:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc36c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.149135:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc36bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac14 expref: 25 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.149155:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc36c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac14 expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.149182:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:3.0:1788869696.149185:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869696.149188:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81535200, rc 0) 00000100:00100000:3.0:1788869696.149299:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+24:12211:x1875765545216768:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 420us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869696.149307:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 159 00000100:00100000:2.0:1788869696.153785:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869696.153862:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545217024 00000100:00100000:1.0:1788869696.153870:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545217024 00000100:00100000:1.0:1788869696.153946:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 160 00000100:00100000:1.0:1788869696.153957:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffac4edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+24:12211:x1875765545217024:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1788869696.153979:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869696.154001:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc36ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaac1b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.154122:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc36d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.154137:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc36d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.154159:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc36d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869696.154174:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788869696.154457:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc36ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac1b expref: 27 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.154471:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc36d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac1b expref: 26 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.154477:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99fe821d6d00) 00010000:00010000:1.0:1788869696.154479:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869696.154482:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80031e00, rc 0) 00000100:00100000:1.0:1788869696.154566:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffac4edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+26:12211:x1875765545217024:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 612us (789us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1788869696.154570:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 160 00000100:00100000:2.0:1788869696.157557:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869696.157670:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545217280 00000100:00100000:0.0:1788869696.157678:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545217280 00000100:00100000:0.0:1788869696.157729:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 161 00000100:00100000:0.0:1788869696.157739:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+26:12211:x1875765545217280:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1788869696.157764:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869696.157782:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc36df lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaac22 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.157875:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc36e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.157886:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc36e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.157894:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc36e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869696.157903:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788869696.157994:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc36df lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac22 expref: 29 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.158010:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc36e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac22 expref: 28 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.158016:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99fe821d6d00) 00010000:00010000:0.0:1788869696.158018:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788869696.158020:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04800, rc 0) 00000100:00100000:0.0:1788869696.158075:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+28:12211:x1875765545217280:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 337us (527us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1788869696.158095:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 161 00000100:00100000:3.0:1788869696.159791:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869696.160598:0:9487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545217408 00000100:00100000:0.0:1788869696.160609:0:9487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545217408 00000100:00100000:0.0:1788869696.160670:0:9487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1788869696.160680:0:9487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4fff62-1855-4361-a244-1a23eb291d37+28:2387:x1875765545217408:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869696.160698:0:9487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869696.160721:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc36d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac1b expref: 28 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.160737:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99fe821d6d00) 00010000:00010000:0.0:1788869696.160740:0:9487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869696.160787:0:9487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4fff62-1855-4361-a244-1a23eb291d37+27:2387:x1875765545217408:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 109us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869696.160793:0:9487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:2.0:1788869696.165297:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869696.165349:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545217536 00000100:00100000:0.0:1788869696.165360:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545217536 00000100:00100000:0.0:1788869696.165419:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:0.0:1788869696.165429:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82cb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:2387:x1875765545217536:12345-192.168.201.30@tcp:1:lfs.0 00010000:00010000:0.0:1788869696.165485:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baafd018/0xbead52e175fc36f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.165506:0:8399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000072d66b96/0xbead52e175fc36a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac06 expref: 6 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.165515:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788869696.165519:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869696.165539:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baafd018/0xbead52e175fc36f4 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.165575:0:8399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000072d66b96/0xbead52e175fc36a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac06 expref: 6 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.165590:0:8399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000072d66b96/0xbead52e175fc36a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac06 expref: 6 pid: 8401 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869696.165604:0:8399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8911180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8399:1875765554721920:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788869696.165711:0:8399:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff88e3e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869696.169589:0:8399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8911180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8399:1875765554721920:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788869696.169631:0:8399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000baafd018/0xbead52e175fc36f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869696.174490:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869696.174700:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545217664 00000100:00100000:1.0:1788869696.174710:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545217664 00002000:00100000:1.0:1788869696.174761:0:8406:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff99ffbf924700 x1875765545217664/t0(0) o4->bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp:642/0 lens 504/0 e 0 to 0 dl 1788869707 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788869696.174773:0:8406:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffbf924700 with x1875765545217664 ext(0->12) 00010000:00010000:1.0:1788869696.174782:0:8406:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000072d66b96/0xbead52e175fc36a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac06 expref: 7 pid: 8401 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.174801:0:8406:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000072d66b96/0xbead52e175fc36a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac06 expref: 7 pid: 8401 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788869696.174820:0:8406:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99ffbf924700 00000100:00100000:1.0:1788869696.174853:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:1.0:1788869696.174864:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf4fff62-1855-4361-a244-1a23eb291d37+7:2387:x1875765545217664:12345-192.168.201.30@tcp:4:lfs.0 00000100:00100000:1.0:1788869696.178461:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf4fff62-1855-4361-a244-1a23eb291d37+9:2387:x1875765545217664:12345-192.168.201.30@tcp:4:lfs.0 Request processed in 3588us (3969us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788869696.178476:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00002000:00100000:1.0:1788869696.178489:0:8406:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff99ffbf924700 x1875765545217664/t4294967306(0) o4->bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp:642/0 lens 504/448 e 0 to 0 dl 1788869707 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788869696.178499:0:8406:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffbf924700 with x1875765545217664 ext(0->12) 00010000:00010000:1.0:1788869696.178511:0:8406:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000072d66b96/0xbead52e175fc36a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac06 expref: 9 pid: 8401 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.178529:0:8406:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000072d66b96/0xbead52e175fc36a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac06 expref: 9 pid: 8401 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788869696.178536:0:8406:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99ffbf924700 00000100:00100000:2.0:1788869696.181448:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869696.181876:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545217792 00000100:00100000:3.0:1788869696.181887:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545217792 00010000:00010000:3.0:1788869696.183055:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000072d66b96/0xbead52e175fc36a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac06 expref: 9 pid: 8401 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869696.183117:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 83 00000100:00100000:3.0:1788869696.183134:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf924380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+9:2388:x1875765545217792:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869696.183152:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788869696.183173:0:9488:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788869696.183176:0:9488:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788869696 00002000:00010000:3.0:1788869696.183179:0:9488:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788869696 00002000:00010000:3.0:1788869696.183181:0:9488:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788869696 00002000:00010000:3.0:1788869696.183183:0:9488:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788869696.183190:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000072d66b96/0xbead52e175fc36a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac06 expref: 9 pid: 8401 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.183205:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000072d66b96/0xbead52e175fc36a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac06 expref: 9 pid: 8401 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.183283:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072d66b96/0xbead52e175fc36a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac06 expref: 9 pid: 8401 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.183299:0:9488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788869696.183304:0:9488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788869696.183310:0:9488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000baafd018/0xbead52e175fc36f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.183320:0:9488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baafd018/0xbead52e175fc36f4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.183359:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869696.183428:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf924380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+8:2388:x1875765545217792:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 303us (1996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869696.183444:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 83 00010000:00010000:0.0:1788869696.183787:0:8399:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000baafd018/0xbead52e175fc36f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.183796:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baafd018/0xbead52e175fc36f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.183816:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baafd018/0xbead52e175fc36f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.183824:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000baafd018/0xbead52e175fc36f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.183844:0:8399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000baafd018/0xbead52e175fc36f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.183850:0:8399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04200 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869696.183854:0:8399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000baafd018/0xbead52e175fc36f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.183862:0:8399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000baafd018/0xbead52e175fc36f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.183874:0:8399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000baafd018/0xbead52e175fc36f4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.183881:0:8399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baafd018/0xbead52e175fc36f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869696.183941:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82cb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+7:2387:x1875765545217536:12345-192.168.201.30@tcp:1:lfs.0 Request processed in 18503us (18641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869696.183950:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:3.0:1788869696.187644:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869696.187721:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545218048 00000100:00100000:0.0:1788869696.187731:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545218048 00000100:00100000:0.0:1788869696.187787:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:0.0:1788869696.187797:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae5b9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+27:12211:x1875765545218048:12345-192.168.201.30@tcp:35:lfs.0 00000004:00010000:0.0:1788869696.187864:0:6488:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc36e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac22 expref: 27 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869696.188072:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1788869696.188100:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788869696.188480:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1788869696.188518:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc36fb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.188534:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc3692 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabf8 expref: 31 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.188544:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc36fb lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.188577:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc3692 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabf8 expref: 31 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.188591:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc3692 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabf8 expref: 31 pid: 6486 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869696.188606:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb8911180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6488:1875765554722048:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788869696.188691:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff88e3e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869696.193141:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb8911180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6488:1875765554722048:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788869696.193174:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc36fb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869696.200753:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869696.200936:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545218176 00000100:00100000:0.0:1788869696.200949:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545218176 00010000:00010000:0.0:1788869696.200996:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc3692 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabf8 expref: 32 pid: 6486 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869696.201061:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00100000:0.0:1788869696.201072:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+32:2387:x1875765545218176:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869696.201089:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869696.201096:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc3692 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabf8 expref: 32 pid: 6486 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.201110:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc3692 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabf8 expref: 32 pid: 6486 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.201146:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc3692 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabf8 expref: 32 pid: 6486 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.201161:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99fe821d6d00) 00010000:00010000:0.0:1788869696.201168:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc36fb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.201177:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc36fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.201184:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc36fb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.201215:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869696.201328:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+31:2387:x1875765545218176:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 257us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869696.201337:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 84 00010000:00010000:3.0:1788869696.201864:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc36fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.201873:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc36fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788869696.202005:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1788869696.202128:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1788869696.202220:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8400f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6488:1875765554722176:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788869696.202339:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869696.202369:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff92602f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869696.202536:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554722176 00000100:00100000:0.0:1788869696.202548:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554722176 00000100:00100000:0.0:1788869696.202589:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788869696.202779:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6488:x1875765554722176:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788869696.202870:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6488:x1875765554722176:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 274us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869696.202877:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788869696.204462:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8400f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6488:1875765554722176:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788869696.205065:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1788869696.205533:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8400f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6488:1875765554722304:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788869696.207048:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869696.207139:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff82fbc300 going to sleep for 11 seconds 00000100:00100000:1.0:1788869696.211472:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554722304 00000100:00100000:1.0:1788869696.211491:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554722304 00000100:00100000:1.0:1788869696.211565:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788869696.211577:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6488:x1875765554722304:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788869696.212129:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6488:x1875765554722304:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 543us (5073us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788869696.212138:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788869696.215403:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8400f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6488:1875765554722304:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788869696.215843:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1788869696.215908:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc36fb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.215921:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc36fb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.215929:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc36fb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.217240:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869696.217247:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc36fb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.217267:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc36fb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.217284:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99fe821d6d00) 00010000:00010000:3.0:1788869696.217287:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788869696.217291:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc36fb lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.217318:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc36fb lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788869696.217460:0:6488:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788869696.217522:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1788869696.217532:0:6488:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 314144278854ns, next at 315144276734ns, rc = 0 00000001:00080000:3.0:1788869696.217540:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1788869696.217574:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99fe821d6d00) 00010000:00010000:3.0:1788869696.217577:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788869696.217585:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc36e6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac22 expref: 35 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869696.217879:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae5b9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+34:12211:x1875765545218048:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 30082us (30242us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1788869696.217889:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 38 00000020:00080000:3.0:1788869696.217895:0:6488:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788869696.222843:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869696.223066:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545218304 00000100:00100000:2.0:1788869696.223076:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545218304 00000100:00100000:2.0:1788869696.223138:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 162 00000100:00100000:2.0:1788869696.223149:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+34:12211:x1875765545218304:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1788869696.223173:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869696.223193:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc3702 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaac29 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.223308:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc3702 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac29 expref: 35 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.223324:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc3702 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac29 expref: 35 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.223344:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:2.0:1788869696.223348:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788869696.223351:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0800, rc 0) 00000100:00100000:2.0:1788869696.223406:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+35:12211:x1875765545218304:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 259us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869696.223820:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 162 00000100:00100000:2.0:1788869696.231128:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869696.231220:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545218560 00000100:00100000:3.0:1788869696.231231:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545218560 00000100:00100000:3.0:1788869696.231337:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:3.0:1788869696.231347:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+35:12211:x1875765545218560:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1788869696.231669:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+36:12211:x1875765545218560:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 322us (561us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1788869696.231678:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:0.0:1788869696.338529:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869696.339160:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545218816 00000100:00100000:1.0:1788869696.339171:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545218816 00000100:00100000:1.0:1788869696.339246:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 163 00000100:00100000:1.0:1788869696.339280:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+36:12221:x1875765545218816:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1788869696.339305:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869696.339327:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc3709 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaac30 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869696.339432:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788869696.339550:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc3709 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac30 expref: 38 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.339672:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff88bbf700) 00010000:00010000:1.0:1788869696.339676:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869696.339682:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031400/0xbead52e175fc3709 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac30 expref: 38 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.339698:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80031400, rc 0) 00000100:00100000:1.0:1788869696.339768:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+37:12221:x1875765545218816:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 491us (1251us total) trans 4294967435 rc 301/301 00000100:00100000:1.0:1788869696.339776:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 163 00000100:00100000:1.0:1788869696.344961:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869696.345037:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545218944 00000100:00100000:0.0:1788869696.345047:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545218944 00000100:00100000:0.0:1788869696.345165:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 164 00000100:00100000:0.0:1788869696.345177:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+37:12221:x1875765545218944:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:0.0:1788869696.345301:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04400/0xbead52e175fc3717 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345319:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04400/0xbead52e175fc3717 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345331:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04400/0xbead52e175fc3717 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345343:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc371e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345350:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc371e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345355:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc371e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345424:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3725 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345456:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345462:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869696.345511:0:9496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345525:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04400/0xbead52e175fc3717 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345531:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04400/0xbead52e175fc3717 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345538:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04400/0xbead52e175fc3717 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345544:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869696.345549:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04400/0xbead52e175fc3717 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345557:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04400/0xbead52e175fc3717 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345690:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:0.0:1788869696.345693:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869696.345698:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04400/0xbead52e175fc3717 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345705:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04400/0xbead52e175fc3717 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345723:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc371e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345729:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc371e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345734:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc371e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345739:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869696.345742:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc371e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345747:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc371e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345754:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99fe821d6300) 00010000:00010000:0.0:1788869696.345756:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869696.345759:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc371e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345764:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc371e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345774:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345779:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3725 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345784:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345793:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05c00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869696.345796:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345802:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3725 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345809:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:0.0:1788869696.345811:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869696.345814:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3725 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.345820:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3725 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869696.345901:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+37:12221:x1875765545218944:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 724us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869696.345909:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 164 00000100:00100000:3.0:1788869696.350582:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869696.350762:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545219200 00000100:00100000:1.0:1788869696.350773:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545219200 00000100:00100000:1.0:1788869696.350835:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:1.0:1788869696.350847:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+37:12221:x1875765545219200:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:1.0:1788869696.351067:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+38:12221:x1875765545219200:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 222us (508us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788869696.351087:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 40 00000040:00080000:1.0:1788869696.408636:0:13761:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788869696.408647:0:13761:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788869696.408755:0:13761:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1788869696.408763:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788869696.409388:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554722688:0@lo:400:kworker.0 00000100:00100000:0.0:1788869696.409463:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869696.409510:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875765554723200:0@lo:400:kworker.0 00000100:00100000:0.0:1788869696.409529:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869696.409546:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875765554723712:0@lo:400:kworker.0 00000100:00100000:0.0:1788869696.409561:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869696.409578:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788869696.409583:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf9ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554722816:0@lo:400:kworker.0 00000100:00100000:0.0:1788869696.409604:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869696.409627:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554723328:0@lo:400:kworker.0 00000100:00100000:0.0:1788869696.409645:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869696.409655:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554723840:0@lo:400:kworker.0 00000100:00100000:0.0:1788869696.409669:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869696.409694:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554722688 00000100:00100000:0.0:1788869696.409699:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554722688 00000100:00100000:0.0:1788869696.409739:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554723200 00000100:00100000:0.0:1788869696.409741:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554723200 00000100:00100000:0.0:1788869696.409758:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554723712 00000100:00100000:0.0:1788869696.409760:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554723712 00000100:00100000:0.0:1788869696.409770:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554723328 00000100:00100000:0.0:1788869696.409772:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554723328 00000100:00100000:0.0:1788869696.409793:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554723840 00000100:00100000:0.0:1788869696.409795:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554723840 00000100:00100000:0.0:1788869696.409808:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788869696.409815:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554722688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869696.409858:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554722688:12345-0@lo:400:kworker.0 Request processed in 43us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869696.409864:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788869696.409878:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788869696.409883:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875765554723200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869696.409903:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875765554723200:12345-0@lo:400:kworker.0 Request processed in 20us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869696.409908:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788869696.409916:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788869696.409921:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875765554723712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869696.409942:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875765554723712:12345-0@lo:400:kworker.0 Request processed in 21us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869696.409957:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788869696.409968:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788869696.409973:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554723328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869696.409999:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554723328:12345-0@lo:400:kworker.0 Request processed in 26us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869696.410005:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788869696.410015:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788869696.410020:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554723840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869696.410043:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554723840:12345-0@lo:400:kworker.0 Request processed in 23us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869696.410048:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00010000:00080000:0.0:1788869696.410079:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82325500 x1875765554723328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869696.410094:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554723328:0@lo:400:kworker.0 00010000:00080000:0.0:1788869696.410104:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffb9e06680 x1875765554723840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869696.410112:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554723840:0@lo:400:kworker.0 00000100:00100000:0.0:1788869696.410121:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554722688:0@lo:400:kworker.0 00000100:00100000:0.0:1788869696.410130:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875765554723200:0@lo:400:kworker.0 00000100:00100000:0.0:1788869696.410137:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875765554723712:0@lo:400:kworker.0 00000100:00080000:3.0:1788869696.410644:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869696.410654:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869696.410665:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554722816 00000100:00100000:3.0:1788869696.410669:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554722816 00000100:00100000:3.0:1788869696.410696:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788869696.410702:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554722816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869696.410752:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554722816:12345-0@lo:400:kworker.0 Request processed in 50us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869696.410757:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788869696.410779:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf9ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554722816:0@lo:400:kworker.0 00000100:00100000:2.0:1788869696.411084:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554722432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869696.411121:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869696.411148:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554722944:0@lo:400:kworker.0 00000100:00100000:2.0:1788869696.411169:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869696.411185:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554723456:0@lo:400:kworker.0 00000100:00100000:2.0:1788869696.411214:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869696.411245:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554723968:0@lo:400:kworker.0 00000100:00100000:2.0:1788869696.411286:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869696.411302:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788869696.411308:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554722560:0@lo:400:kworker.0 00000100:00100000:2.0:1788869696.411329:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869696.411361:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554723072:0@lo:400:kworker.0 00000100:00100000:2.0:1788869696.411381:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869696.411396:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554723584:0@lo:400:kworker.0 00000100:00100000:2.0:1788869696.411422:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869696.411456:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554722560 00000100:00100000:2.0:1788869696.411459:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554722560 00000100:00100000:2.0:1788869696.411488:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1788869696.411495:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554722560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869696.411528:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554722560:12345-0@lo:400:kworker.0 Request processed in 35us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869696.411535:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1788869696.411568:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554723456 00000100:00100000:2.0:1788869696.411571:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554723456 00000100:00100000:0.0:1788869696.411573:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554723072 00000100:00100000:0.0:1788869696.411579:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554723072 00000100:00100000:2.0:1788869696.411602:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554723968 00000100:00100000:2.0:1788869696.411606:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554723968 00000100:00100000:0.0:1788869696.411618:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788869696.411627:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554723584 00000100:00100000:0.0:1788869696.411629:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554723072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869696.411630:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554723584 00000100:00100000:2.0:1788869696.411649:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788869696.411656:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554723456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869696.411675:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554723072:12345-0@lo:400:kworker.0 Request processed in 48us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869696.411682:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788869696.411694:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554723456:12345-0@lo:400:kworker.0 Request processed in 38us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869696.411707:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788869696.411716:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554723968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869696.411746:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554723968:12345-0@lo:400:kworker.0 Request processed in 31us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869696.411775:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554722944 00000100:00100000:1.0:1788869696.411780:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554722944 00000100:00100000:1.0:1788869696.411804:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788869696.411809:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554722944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869696.411842:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554722944:12345-0@lo:400:kworker.0 Request processed in 33us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869696.411847:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788869696.412015:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554722432 00000100:00100000:3.0:1788869696.412019:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554722432 00000100:00100000:3.0:1788869696.412045:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788869696.412051:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1875765554722432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869696.412066:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788869696.412097:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1875765554722432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869696.412102:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1788869696.412132:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869696.412136:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869696.412170:0:8401:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788869696.412177:0:8401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788869696.412206:0:8400:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788869696.412397:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869696.412415:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545219456 00000100:00100000:1.0:1788869696.412418:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545219456 00000100:00100000:1.0:1788869696.412448:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 165 00000100:00100000:1.0:1788869696.412456:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+38:12224:x1875765545219456:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1788869696.412469:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869696.412489:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc372c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaac37 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.412562:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc3733 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.412577:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc3733 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.412589:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc3733 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.412607:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc373a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.412615:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc373a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.412623:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc373a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.412737:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3741 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.412746:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3741 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.412753:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3741 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869696.412765:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788869696.412845:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc3733 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.412853:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc3733 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.412860:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc3733 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.412865:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031e00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869696.412869:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc3733 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.412886:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc3733 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.412898:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:1.0:1788869696.412902:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869696.412906:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc3733 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.412913:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031e00/0xbead52e175fc3733 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.412926:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc373a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.412931:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc373a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.412937:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc373a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.412943:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869696.412946:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc373a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.412951:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc373a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.412959:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99fe821d6300) 00010000:00010000:1.0:1788869696.412961:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869696.412964:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc373a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.412979:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc373a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.413016:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc372c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac37 expref: 41 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.413029:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3741 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac37 expref: 40 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869696.413037:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:1.0:1788869696.413038:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869696.413041:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80030a00, rc 0) 00000100:00100000:1.0:1788869696.413082:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+40:12224:x1875765545219456:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 626us (686us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788869696.413088:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 165 00000100:00100000:2.0:1788869696.413364:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788869696.413381:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788869696.413390:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788869696.413400:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554723584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869696.413461:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554723584:12345-0@lo:400:kworker.0 Request processed in 64us (2046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869696.413467:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788869696.413500:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554722560:0@lo:400:kworker.0 00000100:00100000:2.0:1788869696.413515:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554723072:0@lo:400:kworker.0 00000100:00100000:2.0:1788869696.413524:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554723584:0@lo:400:kworker.0 00000100:00100000:2.0:1788869696.413541:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554722432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869696.413553:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554722944:0@lo:400:kworker.0 00000100:00100000:2.0:1788869696.413563:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554723456:0@lo:400:kworker.0 00000100:00100000:2.0:1788869696.413572:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554723968:0@lo:400:kworker.0 00000100:00100000:1.0:1788869696.419548:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869696.419627:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545219584 00000100:00100000:3.0:1788869696.419637:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545219584 00000100:00100000:3.0:1788869696.419701:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 166 00000100:00100000:3.0:1788869696.419711:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff84f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+40:12224:x1875765545219584:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:3.0:1788869696.419796:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc374f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.419835:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc374f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.419849:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc374f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.419887:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc374f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.419894:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc374f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.419902:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc374f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.419907:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869696.419911:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc374f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.419919:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc374f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.419930:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:3.0:1788869696.419933:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869696.419937:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc374f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.419943:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc374f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869696.420017:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff84f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+40:12224:x1875765545219584:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 307us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869696.420031:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 166 00000100:00100000:2.0:1788869696.426308:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869696.426478:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545219840 00000100:00100000:1.0:1788869696.426489:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545219840 00000100:00100000:1.0:1788869696.426546:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:1.0:1788869696.426556:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+40:12224:x1875765545219840:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:1.0:1788869696.426947:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+41:12224:x1875765545219840:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 392us (650us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788869696.426955:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 41 00010000:00010000:0.0:1788869696.538857:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869696.622298:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869696.622420:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545220096 00000100:00100000:3.0:1788869696.622431:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545220096 00000100:00100000:3.0:1788869696.622503:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 167 00000100:00100000:3.0:1788869696.622514:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+41:12255:x1875765545220096:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:3.0:1788869696.622541:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869696.622566:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3756 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaac3e expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.622685:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc375d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.622703:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc375d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.622716:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc375d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869696.622728:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788869696.622850:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3756 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac3e expref: 44 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.622871:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc375d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac3e expref: 43 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.622880:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:3.0:1788869696.622883:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869696.622886:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534600, rc 0) 00000100:00100000:3.0:1788869696.622979:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+43:12255:x1875765545220096:12345-192.168.201.30@tcp:101:cat.0 Request processed in 466us (731us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788869696.622986:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 167 00000100:00100000:2.0:1788869696.626419:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869696.626531:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545220352 00000100:00100000:1.0:1788869696.626543:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545220352 00000100:00100000:1.0:1788869696.626623:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:1.0:1788869696.626634:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+43:12255:x1875765545220352:12345-192.168.201.30@tcp:35:cat.0 00000100:00100000:1.0:1788869696.626955:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+44:12255:x1875765545220352:12345-192.168.201.30@tcp:35:cat.0 Request processed in 321us (548us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1788869696.626963:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:2.0:1788869696.631785:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869696.632127:0:9487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545220480 00000100:00100000:0.0:1788869696.632145:0:9487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545220480 00000100:00100000:0.0:1788869696.632224:0:9487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1788869696.632235:0:9487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89da9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4fff62-1855-4361-a244-1a23eb291d37+44:2389:x1875765545220480:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869696.632286:0:9487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869696.632311:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc375d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac3e expref: 44 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869696.632334:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:0.0:1788869696.632340:0:9487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869696.632404:0:9487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89da9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4fff62-1855-4361-a244-1a23eb291d37+43:2389:x1875765545220480:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 171us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869696.632411:0:9487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1788869696.695492:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869696.695696:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545220736 00000100:00100000:2.0:1788869696.695706:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545220736 00000100:00100000:2.0:1788869696.695783:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 168 00000100:00100000:2.0:1788869696.695794:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+43:12261:x1875765545220736:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1788869696.695820:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869696.695823:0:12967:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788869696.695863:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc36c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac14 expref: 43 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.695882:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:2.0:1788869696.695887:0:12967:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869696.695901:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc376b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaac45 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.696017:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3772 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.696032:0:12967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3741 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac37 expref: 43 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.696165:0:12967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3772 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.696201:0:12967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3741 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac37 expref: 43 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.696215:0:12967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3741 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac37 expref: 43 pid: 6485 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869696.696228:0:12967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12967:1875765554724096:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788869696.699561:0:12967:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f2180 going to sleep for 11 seconds 00000100:00100000:3.0:1788869696.714206:0:12967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12967:1875765554724096:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869696.714237:0:12967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3772 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869696.715103:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869696.715298:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545220864 00000100:00100000:3.0:1788869696.715307:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545220864 00010000:00010000:3.0:1788869696.715345:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3741 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac37 expref: 44 pid: 6485 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869696.715395:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 85 00000100:00100000:3.0:1788869696.715405:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf924380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+44:2388:x1875765545220864:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869696.715420:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869696.715427:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3741 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac37 expref: 44 pid: 6485 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.715448:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3741 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac37 expref: 44 pid: 6485 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.715470:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3741 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac37 expref: 44 pid: 6485 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.715487:0:9488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:3.0:1788869696.715492:0:9488:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3772 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.715511:0:9488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3772 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.715518:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3772 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.715545:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869696.715606:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf924380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+43:2388:x1875765545220864:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 202us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869696.715614:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 85 00010000:00010000:2.0:1788869696.716088:0:12967:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3772 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.716098:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3772 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869696.716125:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788869696.716289:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc376b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac45 expref: 44 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.716307:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3772 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac45 expref: 43 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.716315:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:2.0:1788869696.716317:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788869696.716320:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1800, rc 0) 00000100:00100000:2.0:1788869696.716355:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+43:12261:x1875765545220736:12345-192.168.201.30@tcp:101:dd.0 Request processed in 20563us (20873us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788869696.716362:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 168 00000100:00100000:0.0:1788869696.720474:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869696.720647:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545220992 00000100:00100000:2.0:1788869696.720657:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545220992 00000100:00100000:2.0:1788869696.720719:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 169 00000100:00100000:2.0:1788869696.720729:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+43:12261:x1875765545220992:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1788869696.720753:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869696.720789:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3780 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaac4c expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.720829:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3787 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.720843:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.720871:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.720986:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3780 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac4c expref: 45 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.721003:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3787 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac4c expref: 44 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.721013:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:2.0:1788869696.721016:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788869696.721019:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1c00, rc 0) 00000100:00100000:2.0:1788869696.721197:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+44:12261:x1875765545220992:12345-192.168.201.30@tcp:101:dd.0 Request processed in 468us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869696.721205:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 169 00000100:00100000:1.0:1788869696.726808:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869696.726953:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545221248 00000100:00100000:2.0:1788869696.726963:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545221248 00000100:00100000:2.0:1788869696.727019:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 170 00000100:00100000:2.0:1788869696.727028:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+44:12261:x1875765545221248:12345-192.168.201.30@tcp:36:dd.0 00010000:00010000:2.0:1788869696.727317:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc378e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.727335:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc378e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.727346:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc378e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788869696.727405:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1788869696.727431:0:6485:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c4c2e210 reply state 0000000031184429 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc378e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.727458:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc378e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.727466:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:2.0:1788869696.727469:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788869696.727472:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869696.727556:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+47:12261:x1875765545221248:12345-192.168.201.30@tcp:36:dd.0 Request processed in 528us (759us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1788869696.727563:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 170 00000020:00080000:2.0:1788869696.727568:0:6485:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1788869696.793146:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788869696.924758:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869696.924883:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545221376 00000100:00100000:2.0:1788869696.924895:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545221376 00000100:00100000:2.0:1788869696.924977:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 171 00000100:00100000:2.0:1788869696.924990:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+47:12275:x1875765545221376:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:2.0:1788869696.925024:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869696.925053:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc3795 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaac53 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.925141:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc379c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.925160:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc379c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.925198:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc379c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.925212:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc37a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.925219:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc37a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.925226:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc37a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.925361:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc37aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.925372:0:12967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3772 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac45 expref: 48 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.925381:0:12967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc37aa lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.925423:0:12967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3772 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac45 expref: 48 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.925448:0:12967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3772 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac45 expref: 48 pid: 12967 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869696.925464:0:12967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bb800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12967:1875765554724224:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788869696.925630:0:12967:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f2240 going to sleep for 11 seconds 00000100:00100000:0.0:1788869696.932027:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869696.935726:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545221632 00000100:00100000:1.0:1788869696.935750:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545221632 00000100:00100000:1.0:1788869696.935864:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:1.0:1788869696.935877:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+49:6152:x1875765545221632:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788869696.936342:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+50:6152:x1875765545221632:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 466us (4328us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1788869696.936352:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:2.0:1788869696.936991:0:12967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bb800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12967:1875765554724224:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788869696.937023:0:12967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc37aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869696.938585:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869696.938688:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545221760 00000100:00100000:2.0:1788869696.938699:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545221760 00010000:00010000:2.0:1788869696.938745:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3772 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac45 expref: 50 pid: 12967 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869696.938794:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 86 00000100:00100000:2.0:1788869696.938805:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+50:2388:x1875765545221760:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869696.938826:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869696.938835:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3772 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac45 expref: 50 pid: 12967 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.938850:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3772 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac45 expref: 50 pid: 12967 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.938879:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3772 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac45 expref: 50 pid: 12967 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.938901:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:2.0:1788869696.938908:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc37aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.938919:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc37aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.938928:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc37aa lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869696.939031:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869696.939104:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+49:2388:x1875765545221760:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 300us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869696.939113:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 86 00010000:00010000:3.0:1788869696.939655:0:12967:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc37aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.939666:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc37aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869696.939737:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788869696.939743:0:12967:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869696.939777:0:12967:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc37aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.939795:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc37aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.939807:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc379c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.939814:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc379c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.939823:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc379c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.939840:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869696.939845:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc379c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.939854:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc379c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.939866:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:3.0:1788869696.939870:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869696.939874:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc379c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.939881:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc379c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.939895:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc37a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.939901:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc37a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.939906:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc37a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.939911:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1e00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869696.939914:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc37a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.939919:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc37a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.939938:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99fe821d6300) 00010000:00010000:3.0:1788869696.939941:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869696.939944:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc37a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.939950:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc37a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.939986:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc3795 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac53 expref: 49 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.940001:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc37aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac53 expref: 48 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.940010:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:3.0:1788869696.940013:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869696.940015:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0c00, rc 0) 00000100:00100000:3.0:1788869696.940074:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+48:12275:x1875765545221376:12345-192.168.201.30@tcp:101:stat.0 Request processed in 15087us (15333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869696.940082:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 171 00000100:00100000:1.0:1788869696.985604:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869696.985648:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545222016 00000100:00100000:3.0:1788869696.985662:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545222016 00000100:00100000:3.0:1788869696.986214:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 172 00000100:00100000:3.0:1788869696.986229:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+48:12281:x1875765545222016:12345-192.168.201.30@tcp:36:truncate.0 00010000:00010000:3.0:1788869696.986342:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869696.986382:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc37aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac53 expref: 48 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.986429:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:3.0:1788869696.986435:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869696.986737:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc37b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.986758:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc37b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.986769:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc37b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788869696.986818:0:9496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1788869696.986841:0:9496:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002af11167 reply state 0000000076243799 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc37b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.986919:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc37b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869696.986927:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:3.0:1788869696.986930:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788869696.986933:0:9496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788869696.987057:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+50:12281:x1875765545222016:12345-192.168.201.30@tcp:36:truncate.0 Request processed in 830us (1462us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788869696.987065:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 172 00000020:00080000:3.0:1788869696.987071:0:9496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788869697.111069:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869697.111137:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545222144 00000100:00100000:3.0:1788869697.111150:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545222144 00000100:00080000:0.0:1788869697.111335:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869697.111342:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 173 00000100:00100000:3.0:1788869697.111359:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+50:12295:x1875765545222144:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:3.0:1788869697.111424:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869697.111486:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc37b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaac5a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.111574:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc37bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.111594:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc37bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.111611:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc37bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.111625:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc37c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.111632:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc37c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.111639:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc37c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.111737:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.111747:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.111755:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869697.111811:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788869697.111822:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869697.111851:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.111866:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.111876:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc37bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.111884:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc37bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.111891:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc37bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.111898:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534600 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869697.111904:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc37bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.111913:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc37bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.111941:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:3.0:1788869697.111946:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869697.111951:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc37bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.111958:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc37bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.111977:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc37c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.111994:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc37c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.112001:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc37c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.112005:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9e800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869697.112019:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc37c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.112026:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc37c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.112034:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99fe821d6300) 00010000:00010000:3.0:1788869697.112037:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869697.112041:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc37c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.112047:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc37c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.112078:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc37b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac5a expref: 52 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.112095:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac5a expref: 51 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.112105:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:3.0:1788869697.112107:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869697.112116:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9f600, rc 0) 00000100:00100000:3.0:1788869697.112202:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+51:12295:x1875765545222144:12345-192.168.201.30@tcp:101:stat.0 Request processed in 849us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869697.112210:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 173 00000100:00100000:1.0:1788869697.174575:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869697.174710:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545222400 00000100:00100000:3.0:1788869697.174725:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545222400 00000100:00100000:3.0:1788869697.174806:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 174 00000100:00100000:3.0:1788869697.174819:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+51:12305:x1875765545222400:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869697.174848:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869697.174879:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc37d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaac61 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869697.175056:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788869697.175193:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc37d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac61 expref: 53 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.175211:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff88bbf700) 00010000:00010000:3.0:1788869697.175214:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869697.175220:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc37d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac61 expref: 53 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.175237:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9e800, rc 0) 00000100:00100000:3.0:1788869697.175536:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+52:12305:x1875765545222400:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 718us (975us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1788869697.175545:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 174 00000100:00100000:1.0:1788869697.179205:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869697.179294:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545222656 00000100:00100000:3.0:1788869697.179379:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545222656 00000100:00100000:3.0:1788869697.179469:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:3.0:1788869697.179503:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae5ba050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+52:12305:x1875765545222656:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1788869697.179967:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae5ba050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+53:12305:x1875765545222656:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 468us (776us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1788869697.179976:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:0.0:1788869697.231095:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869697.231298:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545222912 00000100:00100000:3.0:1788869697.231382:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545222912 00000100:00100000:3.0:1788869697.231483:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 175 00000100:00100000:3.0:1788869697.231793:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+53:12311:x1875765545222912:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1788869697.231827:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869697.231876:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc37e2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaac68 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.232015:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc37e9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.232034:0:9496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac5a expref: 54 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.232045:0:9496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc37e9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.232133:0:9496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac5a expref: 54 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.232148:0:9496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac5a expref: 54 pid: 6484 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869697.232164:0:9496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8335e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9496:1875765554724352:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869697.232723:0:9496:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff87384600 going to sleep for 11 seconds 00000100:00100000:1.0:1788869697.237754:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869697.238216:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545223040 00000100:00100000:0.0:1788869697.238234:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545223040 00010000:00010000:0.0:1788869697.238359:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37cd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac5a expref: 55 pid: 6484 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869697.238455:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 87 00000100:00100000:1.0:1788869697.238470:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+55:2387:x1875765545223040:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869697.238489:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869697.238496:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37cd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac5a expref: 55 pid: 6484 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869697.238531:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac5a expref: 55 pid: 6484 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869697.238559:0:9488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:1.0:1788869697.238565:0:9488:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc37e9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869697.238574:0:9488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc37e9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869697.238580:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc37e9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869697.238602:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869697.238659:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac5a expref: 55 pid: 6484 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869697.238680:0:9496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8335e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9496:1875765554724352:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869697.238709:0:9496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc37e9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.238720:0:9496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc37e9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.238727:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc37e9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869697.238753:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000100:00100000:1.0:1788869697.238755:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+54:2387:x1875765545223040:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 289us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869697.238765:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 87 00010000:00010000:3.0:1788869697.240583:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc37e2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac68 expref: 55 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.240618:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc37e9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac68 expref: 54 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.240629:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:3.0:1788869697.240633:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788869697.240638:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9ee00, rc 0) 00000100:00100000:3.0:1788869697.240798:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+54:12311:x1875765545222912:12345-192.168.201.30@tcp:101:bash.0 Request processed in 9301us (9717us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788869697.240808:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 175 00000100:00100000:1.0:1788869697.247180:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869697.247296:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545223296 00000100:00100000:3.0:1788869697.247330:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545223296 00000100:00100000:3.0:1788869697.247410:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 176 00000100:00100000:3.0:1788869697.247433:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+54:12311:x1875765545223296:12345-192.168.201.30@tcp:36:bash.0 00010000:00010000:3.0:1788869697.247746:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.247770:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.247786:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788869697.247842:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1788869697.247868:0:6484:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a4b79c7f reply state 00000000d218b56d transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.247883:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.247892:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:3.0:1788869697.247896:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788869697.247901:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788869697.248023:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+57:12311:x1875765545223296:12345-192.168.201.30@tcp:36:bash.0 Request processed in 602us (855us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1788869697.248031:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 176 00000020:00080000:3.0:1788869697.248037:0:6484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788869697.252745:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869697.252852:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545223424 00000100:00100000:3.0:1788869697.252865:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545223424 00000100:00100000:2.0:1788869697.253014:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 177 00000100:00100000:2.0:1788869697.253030:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+57:12311:x1875765545223424:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1788869697.253066:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869697.253100:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc37fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaac6f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.253230:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3805 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.253351:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc37e9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac68 expref: 58 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.253362:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3805 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.253407:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc37e9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac68 expref: 58 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.253424:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc37e9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac68 expref: 58 pid: 9496 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869697.253451:0:6486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839b9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6486:1875765554724480:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788869697.253635:0:6486:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb98f2240 going to sleep for 11 seconds 00000100:00100000:0.0:1788869697.256595:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869697.256712:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545223552 00000100:00100000:1.0:1788869697.256724:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545223552 00010000:00010000:1.0:1788869697.256779:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc37e9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac68 expref: 59 pid: 9496 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869697.256835:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 88 00000100:00100000:1.0:1788869697.256847:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+59:2388:x1875765545223552:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869697.256867:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869697.256877:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc37e9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac68 expref: 59 pid: 9496 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869697.256913:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc37e9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac68 expref: 59 pid: 9496 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869697.256956:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:1.0:1788869697.256964:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3805 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869697.256976:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3805 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869697.256985:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3805 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869697.257009:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869697.257080:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+59:2388:x1875765545223552:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 235us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869697.257090:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 88 00010000:00010000:2.0:1788869697.257852:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc37e9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac68 expref: 58 pid: 9496 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869697.257874:0:6486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839b9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6486:1875765554724480:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788869697.257901:0:6486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3805 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.257912:0:6486:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3805 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.257918:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3805 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869697.257996:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788869697.258001:0:6486:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869697.258025:0:6486:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3805 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.258062:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc37fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac6f expref: 58 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.258080:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3805 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac6f expref: 57 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.258087:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:2.0:1788869697.258090:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869697.258093:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0c00, rc 0) 00000100:00100000:2.0:1788869697.258154:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+57:12311:x1875765545223424:12345-192.168.201.30@tcp:101:bash.0 Request processed in 5129us (5423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869697.258174:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 177 00000100:00100000:0.0:1788869697.261854:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869697.261966:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545223808 00000100:00100000:3.0:1788869697.261978:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545223808 00000100:00100000:3.0:1788869697.262052:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:3.0:1788869697.262065:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+57:12311:x1875765545223808:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:2.0:1788869697.262859:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+58:12311:x1875765545223808:12345-192.168.201.30@tcp:35:bash.0 Request processed in 793us (1015us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788869697.262870:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:0.0:1788869697.351110:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869697.351227:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545224064 00000100:00100000:3.0:1788869697.351241:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545224064 00000100:00100000:3.0:1788869697.351362:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 178 00000100:00100000:3.0:1788869697.351374:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+58:12321:x1875765545224064:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869697.351405:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869697.351448:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc380c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaac76 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869697.351583:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788869697.351719:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc380c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac76 expref: 60 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.351737:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff88bbf700) 00010000:00010000:3.0:1788869697.351740:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869697.351746:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc380c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac76 expref: 60 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.351764:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9e800, rc 0) 00000100:00100000:3.0:1788869697.351836:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+59:12321:x1875765545224064:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 464us (742us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1788869697.351843:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 178 00000100:00100000:3.0:1788869697.354858:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869697.354962:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545224192 00000100:00100000:2.0:1788869697.354975:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545224192 00000100:00100000:2.0:1788869697.355046:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 179 00000100:00100000:2.0:1788869697.355059:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+59:12321:x1875765545224192:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:2.0:1788869697.355163:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc381a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355185:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc381a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355199:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc381a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355213:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc3821 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355221:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc3821 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355228:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc3821 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355369:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3828 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355380:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3828 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355406:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3828 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869697.355481:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3828 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355497:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc381a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355504:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc381a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355512:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc381a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355519:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869697.355524:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc381a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355533:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc381a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355548:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:2.0:1788869697.355551:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869697.355557:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc381a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355564:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc381a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355579:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc3821 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355591:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc3821 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355597:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc3821 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355602:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869697.355606:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc3821 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355612:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc3821 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355620:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99fe821d6300) 00010000:00010000:2.0:1788869697.355622:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869697.355625:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc3821 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355631:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc3821 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355642:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3828 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355648:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3828 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355654:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3828 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355659:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1e00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869697.355672:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3828 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355678:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3828 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355685:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:2.0:1788869697.355688:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869697.355690:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3828 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.355696:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3828 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869697.355783:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+59:12321:x1875765545224192:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 726us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869697.355793:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 179 00000100:00100000:0.0:1788869697.357768:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869697.357845:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545224448 00000100:00100000:1.0:1788869697.357858:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545224448 00000100:00100000:1.0:1788869697.357919:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:1.0:1788869697.357940:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+59:12321:x1875765545224448:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:1.0:1788869697.358221:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+60:12321:x1875765545224448:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 293us (458us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788869697.358229:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:0.0:1788869697.388951:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869697.389148:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545224704 00000100:00100000:3.0:1788869697.389163:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545224704 00000100:00100000:3.0:1788869697.389243:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 180 00000100:00100000:3.0:1788869697.389289:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+60:12324:x1875765545224704:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869697.389345:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869697.389372:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc382f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaac7d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.389489:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3836 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.389507:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3836 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.389522:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3836 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.389539:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc383d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.389547:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc383d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.389554:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc383d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.389688:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3844 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.389699:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3844 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.389707:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3844 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869697.389719:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788869697.389829:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3836 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.389839:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3836 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.389847:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3836 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.389854:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9f400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869697.389859:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3836 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.389868:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3836 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.389884:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:3.0:1788869697.389888:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869697.389895:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3836 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.389902:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3836 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.389919:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc383d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.389926:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc383d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.389933:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc383d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.389939:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fc00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869697.389949:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc383d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.389956:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc383d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.389964:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99fe821d6300) 00010000:00010000:3.0:1788869697.389966:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869697.389970:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc383d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.389977:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc383d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.390098:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc382f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac7d expref: 63 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.390116:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3844 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac7d expref: 62 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.390125:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:3.0:1788869697.390127:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869697.390131:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9fe00, rc 0) 00000100:00100000:3.0:1788869697.390227:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+62:12324:x1875765545224704:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 973us (1304us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788869697.390236:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 180 00000100:00100000:3.0:1788869697.392969:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869697.393182:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545224832 00000100:00100000:2.0:1788869697.393196:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545224832 00000100:00100000:2.0:1788869697.393370:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 181 00000100:00100000:2.0:1788869697.393383:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+62:12324:x1875765545224832:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:2.0:1788869697.393491:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3852 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.393513:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3852 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.393527:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3852 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.393584:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3852 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.393610:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3852 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.393618:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3852 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.393626:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1e00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869697.393630:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3852 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.393639:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3852 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.393654:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:2.0:1788869697.393657:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788869697.393663:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3852 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869697.393671:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3852 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869697.393754:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+62:12324:x1875765545224832:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 374us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869697.393763:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 181 00000100:00100000:1.0:1788869697.402173:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869697.402536:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869697.402617:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545225216 00000100:00100000:3.0:1788869697.402631:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545225216 00000100:00100000:3.0:1788869697.402704:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:3.0:1788869697.402736:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+62:12324:x1875765545225216:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1788869697.403148:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+63:12324:x1875765545225216:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 415us (612us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788869697.403158:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:0.0:1788869697.415668:0:9487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545224960 00000100:00100000:0.0:1788869697.415691:0:9487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545224960 00000100:00100000:0.0:1788869697.415798:0:9487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:0.0:1788869697.415812:0:9487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4fff62-1855-4361-a244-1a23eb291d37+63:2390:x1875765545224960:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869697.415837:0:9487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869697.415872:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3844 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac7d expref: 63 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869697.415899:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:0.0:1788869697.415906:0:9487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869697.416012:0:9487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4fff62-1855-4361-a244-1a23eb291d37+62:2390:x1875765545224960:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 203us (13855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869697.416022:0:9487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00010000:00010000:1.0:1788869697.563004:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869697.563131:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869697.563432:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545225472 00000100:00100000:3.0:1788869697.563471:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545225472 00000100:00100000:3.0:1788869697.563550:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 182 00000100:00100000:3.0:1788869697.563564:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+62:12342:x1875765545225472:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:3.0:1788869697.563601:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869697.563631:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3859 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaac84 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.563773:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3860 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.563792:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3860 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.563805:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3860 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869697.563820:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788869697.563962:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3859 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac84 expref: 65 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.563983:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3860 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac84 expref: 64 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.564012:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:3.0:1788869697.564015:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788869697.564020:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9fc00, rc 0) 00000100:00100000:3.0:1788869697.564110:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+64:12342:x1875765545225472:12345-192.168.201.30@tcp:101:cat.0 Request processed in 549us (986us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1788869697.564118:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 182 00000100:00100000:2.0:1788869697.590738:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869697.590856:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545225600 00000100:00100000:0.0:1788869697.590888:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545225600 00000100:00100000:0.0:1788869697.591330:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 183 00000100:00100000:0.0:1788869697.591343:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+64:12343:x1875765545225600:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1788869697.591376:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869697.591403:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04600/0xbead52e175fc386e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaac8b expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869697.591666:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04400/0xbead52e175fc3875 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869697.591682:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04400/0xbead52e175fc3875 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869697.591695:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04400/0xbead52e175fc3875 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869697.591747:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788869697.591751:0:9496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869697.591773:0:9496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04400/0xbead52e175fc3875 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869697.591803:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04600/0xbead52e175fc386e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac8b expref: 66 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869697.591824:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04400/0xbead52e175fc3875 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac8b expref: 65 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869697.591834:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:0.0:1788869697.591837:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869697.591841:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04400, rc 0) 00000100:00100000:0.0:1788869697.592583:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+65:12343:x1875765545225600:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1238us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869697.592593:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 183 00000100:00100000:2.0:1788869697.599058:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869697.599170:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545225984 00000100:00100000:0.0:1788869697.599184:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545225984 00000100:00100000:0.0:1788869697.599367:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:0.0:1788869697.599380:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+65:12343:x1875765545225984:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1788869697.599887:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+66:12343:x1875765545225984:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 509us (844us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788869697.599898:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:1.0:1788869697.603056:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869697.603163:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545226112 00000100:00100000:3.0:1788869697.603176:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545226112 00000100:00100000:3.0:1788869697.603366:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:3.0:1788869697.603380:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+66:12343:x1875765545226112:12345-192.168.201.30@tcp:103:lfs.0 00010000:00010000:3.0:1788869697.603405:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788869697.603458:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3805 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac6f expref: 66 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.603487:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3860 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac84 expref: 65 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.603504:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc3702 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac29 expref: 64 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.603516:0:9488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:3.0:1788869697.603523:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869697.603601:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+63:12343:x1875765545226112:12345-192.168.201.30@tcp:103:lfs.0 Request processed in 223us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869697.603609:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:2.0:1788869697.606201:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869697.606367:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545226240 00000100:00100000:3.0:1788869697.606378:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545226240 00000100:00100000:3.0:1788869697.606460:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 184 00000100:00100000:3.0:1788869697.606474:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+63:12343:x1875765545226240:12345-192.168.201.30@tcp:58:lfs.0 00010000:00010000:3.0:1788869697.606622:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc387c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.606643:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc387c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.606655:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc387c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788869697.606776:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788869697.607086:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+63:12343:x1875765545226240:12345-192.168.201.30@tcp:58:lfs.0 Request processed in 615us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869697.607095:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 184 00000100:00100000:2.0:1788869697.626287:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869697.626516:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545226368 00000100:00100000:3.0:1788869697.626529:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545226368 00000100:00100000:3.0:1788869697.626601:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 185 00000100:00100000:3.0:1788869697.626611:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+63:12345:x1875765545226368:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869697.626638:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869697.626663:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3883 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaac92 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.626743:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc388a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.626762:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc388a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.626792:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc388a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.626805:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3891 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.626813:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3891 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.626820:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3891 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.626912:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3898 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.626922:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.626944:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869697.626998:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788869697.627003:0:12967:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869697.627027:0:12967:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.627041:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3898 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.627051:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc388a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.627070:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc388a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.627076:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc388a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.627083:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9f400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869697.627088:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc388a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.627097:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc388a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.627113:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:3.0:1788869697.627116:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869697.627122:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc388a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.627129:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc388a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.627144:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3891 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.627150:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3891 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.627156:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3891 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.627161:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fe00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869697.627170:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3891 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.627176:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3891 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.627184:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99fe821d6300) 00010000:00010000:3.0:1788869697.627186:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869697.627189:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3891 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.627194:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3891 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.627223:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3883 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac92 expref: 65 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.627237:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3898 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac92 expref: 64 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869697.627244:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:3.0:1788869697.627246:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869697.627249:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9ee00, rc 0) 00000100:00100000:3.0:1788869697.627392:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+64:12345:x1875765545226368:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 781us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869697.627400:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 185 00000100:00100000:0.0:1788869698.157187:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869698.157242:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869698.157299:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869698.157325:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869698.157348:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869698.157368:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869698.157395:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869698.157427:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545226496 00000100:00100000:0.0:1788869698.157450:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545226496 00000100:00100000:0.0:1788869698.157520:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 388 00000100:00100000:0.0:1788869698.157532:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2387:x1875765545226496:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869698.157634:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2387:x1875765545226496:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 103us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869698.157643:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 388 00000100:00100000:0.0:1788869698.157685:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545226624 00000100:00100000:0.0:1788869698.157690:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545226624 00000100:00100000:0.0:1788869698.157729:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545227136 00000100:00100000:0.0:1788869698.157732:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545227136 00000100:00100000:0.0:1788869698.157763:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545226752 00000100:00100000:0.0:1788869698.157765:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545226752 00000100:00100000:0.0:1788869698.157779:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545227264 00000100:00100000:0.0:1788869698.157781:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545227264 00000100:00100000:0.0:1788869698.157796:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 328 00000100:00100000:0.0:1788869698.157802:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+64:2387:x1875765545226624:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869698.157933:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545226880 00000100:00100000:2.0:1788869698.157944:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545226880 00000100:00100000:2.0:1788869698.157978:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545227008 00000100:00100000:2.0:1788869698.157981:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545227008 00000100:00100000:2.0:1788869698.158013:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 134 00000100:00100000:2.0:1788869698.158021:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:2387:x1875765545226880:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869698.158052:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+6:2387:x1875765545226880:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869698.158059:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 134 00000100:00100000:2.0:1788869698.158075:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 135 00000100:00100000:2.0:1788869698.158081:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+7:2387:x1875765545227008:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869698.158105:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+7:2387:x1875765545227008:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869698.158112:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 135 00000100:00100000:3.0:1788869698.158214:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 329 00000100:00100000:3.0:1788869698.158224:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545227136:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869698.158279:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545227136:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 57us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869698.158293:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 329 00000100:00100000:3.0:1788869698.158308:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 330 00000100:00100000:3.0:1788869698.158314:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545226752:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869698.158341:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545226752:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869698.158347:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 330 00000100:00100000:3.0:1788869698.158358:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 331 00000100:00100000:3.0:1788869698.158364:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545227264:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869698.158389:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545227264:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869698.158395:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 331 00000100:00100000:0.0:1788869698.158495:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+64:2387:x1875765545226624:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 691us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869698.158502:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 328 00000100:00080000:0.0:1788869698.158697:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869698.158703:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788869698.158706:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869698.158707:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869698.456469:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869698.456504:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554724608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869698.456596:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869698.456681:0:13961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554724608 00000100:00100000:0.0:1788869698.456692:0:13961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554724608 00000100:00100000:0.0:1788869698.456783:0:13961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788869698.456794:0:13961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554724608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869698.456835:0:13961:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788869698.456887:0:13961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554724608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869698.456895:0:13961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:0.0:1788869698.456920:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869698.456968:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554724608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869698.457678:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869698.457690:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbf9ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554724736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869698.457744:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869698.457795:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554724736 00000100:00100000:3.0:1788869698.457800:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554724736 00000100:00100000:3.0:1788869698.457837:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788869698.457844:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554724736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869698.457862:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788869698.457899:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554724736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869698.457906:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788869698.457938:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbf9ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554724736:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788869698.458366:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788869698.459955:0:13761:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788869698.459964:0:13761:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788869698.460032:0:13761:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788869698.460045:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788869698.460224:0:13761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffb9e06680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1875765554724864:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788869698.460573:0:13761:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff88e3e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869698.479205:0:13761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffb9e06680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1875765554724864:192.168.201.30@tcp:107:hsm_cdtr.0 00000040:00080000:0.0:1788869698.484470:0:14619:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788869698.484484:0:14619:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788869698.484529:0:14619:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788869698.484537:0:14619:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788869698.492847:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869698.493272:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545227392 00000100:00100000:1.0:1788869698.493285:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545227392 00000100:00100000:1.0:1788869698.493367:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 186 00000100:00100000:1.0:1788869698.493378:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf9ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+64:12356:x1875765545227392:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788869698.493421:0:9496:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788869698.493582:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf9ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+64:12356:x1875765545227392:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 205us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869698.493592:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 186 00000100:00100000:3.0:1788869698.501935:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869698.502039:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545227520 00000100:00100000:0.0:1788869698.502054:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545227520 00000100:00100000:0.0:1788869698.502127:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 187 00000100:00100000:0.0:1788869698.502140:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe838ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+64:12356:x1875765545227520:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788869698.502238:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc389f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.502289:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc389f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.502307:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc389f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503417:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38a6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503455:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503488:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503529:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc38ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503539:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc38ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503547:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc38ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869698.503601:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788869698.503606:0:12967:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869698.503622:0:12967:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc38ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503634:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc389f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503640:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc389f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503657:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc389f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503664:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04c00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869698.503668:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc389f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503675:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc389f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503694:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffb89e0700) 00010000:00010000:0.0:1788869698.503697:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869698.503703:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc389f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503709:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc389f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503732:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503739:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38a6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503744:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38a6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503749:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869698.503753:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38a6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503758:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38a6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503766:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff99fe821d6400) 00010000:00010000:0.0:1788869698.503769:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869698.503772:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38a6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503778:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38a6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503804:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc38ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503811:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc38ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503816:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc38ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503821:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869698.503825:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc38ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503831:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc38ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503838:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:0.0:1788869698.503840:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869698.503843:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc38ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.503919:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc38ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869698.504073:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe838ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+64:12356:x1875765545227520:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 Request processed in 1931us (2149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869698.504084:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 187 00000100:00100000:1.0:1788869698.514183:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869698.514500:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545227776 00000100:00100000:0.0:1788869698.514515:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545227776 00000100:00100000:0.0:1788869698.514626:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 188 00000100:00100000:0.0:1788869698.514654:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+64:12356:x1875765545227776:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869698.514684:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869698.514728:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc38b4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaac99 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.514863:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.514883:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.514897:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869698.514913:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788869698.515017:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.515025:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.515032:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.515039:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869698.515045:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.515053:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.515068:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:0.0:1788869698.515078:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869698.515084:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38bb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.515091:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.515143:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc38b4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac99 expref: 66 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.515155:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffb89e0700) 00010000:00010000:0.0:1788869698.515158:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788869698.515162:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc38b4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac99 expref: 66 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.515172:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04000, rc 0) 00000100:00100000:0.0:1788869698.515287:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+65:12356:x1875765545227776:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 636us (1119us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1788869698.515297:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 188 00000100:00100000:2.0:1788869698.525567:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869698.526450:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545227904 00000100:00100000:0.0:1788869698.526466:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545227904 00000100:00100000:0.0:1788869698.526540:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 189 00000100:00100000:0.0:1788869698.526549:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf959c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+65:12356:x1875765545227904:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788869698.526588:0:6484:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788869698.526711:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf959c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+65:12356:x1875765545227904:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 163us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869698.526717:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 189 00000100:00100000:2.0:1788869698.533760:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869698.533948:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545228160 00000100:00100000:0.0:1788869698.533977:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545228160 00000100:00100000:0.0:1788869698.534042:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 190 00000100:00100000:0.0:1788869698.534054:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff87299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+65:12356:x1875765545228160:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869698.534076:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869698.534080:0:12967:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788869698.534108:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04400/0xbead52e175fc3875 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac8b expref: 65 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.534125:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:0.0:1788869698.534131:0:12967:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869698.534144:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc38c9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaca0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788869698.534570:0:12967:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788869698.534712:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.534727:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.534738:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.534796:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc38c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaca0 expref: 67 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.534811:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaca0 expref: 66 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.534833:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99fe821d6400) 00010000:00010000:0.0:1788869698.534835:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869698.534837:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04800, rc 0) 00000100:00100000:0.0:1788869698.534901:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff87299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+66:12356:x1875765545228160:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 849us (1154us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788869698.534908:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 190 00000100:00100000:3.0:1788869698.544128:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869698.544203:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545228416 00000100:00100000:1.0:1788869698.544213:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545228416 00000100:00100000:1.0:1788869698.544302:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 191 00000100:00100000:1.0:1788869698.544314:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+66:12356:x1875765545228416:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788869698.544372:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869698.544400:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc38d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaca0 expref: 66 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.544419:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99fe821d6400) 00010000:00010000:1.0:1788869698.544429:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869698.544464:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc38de lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.544477:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc38de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.544499:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc38de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.545802:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc38e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x37f4122b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.545819:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc38e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x37f4122b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.545828:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc38e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x37f4122b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.545882:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc38de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.545889:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc38de lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.545896:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc38de lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.545902:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869698.545906:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc38de lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.545913:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc38de lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.545924:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:1.0:1788869698.545926:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869698.545931:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc38de lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.545947:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc38de lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.545961:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc38e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x37f4122b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.545967:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc38e5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x37f4122b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.545973:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc38e5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x37f4122b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.545979:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869698.545982:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc38e5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x37f4122b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.545988:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc38e5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x37f4122b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.545996:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x37f4122b (ffff99fe831e6d00) 00010000:00010000:1.0:1788869698.545999:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869698.546001:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc38e5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x37f4122b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.546007:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc38e5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x37f4122b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869698.546108:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+65:12356:x1875765545228416:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 1794us (1986us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788869698.546117:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 191 00000100:00100000:3.0:1788869698.548048:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869698.549039:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545228544 00000100:00100000:0.0:1788869698.549052:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545228544 00000100:00100000:0.0:1788869698.549157:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 192 00000100:00100000:0.0:1788869698.549169:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+65:12356:x1875765545228544:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869698.549190:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869698.549215:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc38ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaca7 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.549295:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc38f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.549310:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc38f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.549322:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc38f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.549435:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc38ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaca7 expref: 67 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.549465:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc38f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaca7 expref: 66 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.549482:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99fe821d6f00) 00010000:00010000:0.0:1788869698.549485:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788869698.549488:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04200, rc 0) 00000100:00100000:0.0:1788869698.549549:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+66:12356:x1875765545228544:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 381us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869698.549556:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 192 00000100:00100000:1.0:1788869698.558147:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869698.558376:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545228800 00000100:00100000:3.0:1788869698.558386:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545228800 00000100:00100000:3.0:1788869698.558459:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 193 00000100:00100000:3.0:1788869698.558469:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+66:12356:x1875765545228800:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788869698.558560:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc38fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.558577:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc38fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.558589:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc38fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788869698.558770:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788869698.558780:0:9496:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 316485526917ns, next at 317485524454ns, rc = 0 00000004:00010000:3.0:1788869698.558833:0:9496:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a667e9e0 reply state 00000000daec1cc8 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc38fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.558846:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc38fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.558854:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99fe821d6f00) 00010000:00010000:3.0:1788869698.558857:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788869698.558861:0:9496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788869698.558961:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+68:12356:x1875765545228800:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 493us (825us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788869698.558969:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 193 00000100:00100000:1.0:1788869698.562495:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869698.562670:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545228928 00000100:00100000:0.0:1788869698.562680:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545228928 00000100:00100000:0.0:1788869698.562747:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 194 00000100:00100000:0.0:1788869698.562758:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+68:12356:x1875765545228928:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869698.562782:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869698.562804:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3901 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaacae expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.562865:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3901 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacae expref: 69 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.562880:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3901 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacae expref: 69 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.562900:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99fe821d6f00) 00010000:00010000:0.0:1788869698.562904:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869698.562907:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb05c00, rc 0) 00000100:00100000:0.0:1788869698.562972:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+69:12356:x1875765545228928:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 215us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869698.562998:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 194 00000100:00100000:3.0:1788869698.566309:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869698.567591:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545229056 00000100:00100000:0.0:1788869698.567607:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545229056 00000100:00100000:0.0:1788869698.567685:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:0.0:1788869698.567695:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+6:2389:x1875765545229056:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788869698.567929:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+7:2389:x1875765545229056:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 234us (1631us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788869698.567938:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:1.0:1788869698.572781:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869698.572835:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545229312 00000100:00100000:3.0:1788869698.572849:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545229312 00000100:00100000:3.0:1788869698.575563:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:3.0:1788869698.575585:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+69:12356:x1875765545229312:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788869698.575900:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+70:12356:x1875765545229312:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 321us (3126us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788869698.575909:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:1.0:1788869698.579728:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869698.583183:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545229568 00000100:00100000:2.0:1788869698.583202:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545229568 00000100:00100000:1.0:1788869698.583357:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 195 00000100:00100000:1.0:1788869698.583381:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+70:12356:x1875765545229568:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788869698.583701:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+70:12356:x1875765545229568:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 330us (3981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869698.583711:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 195 00000100:00100000:3.0:1788869698.588093:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869698.588135:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545229696 00000100:00100000:3.0:1788869698.588146:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545229696 00000100:00100000:3.0:1788869698.588206:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 196 00000100:00100000:3.0:1788869698.588217:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+70:12356:x1875765545229696:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869698.588425:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869698.588477:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869698.588501:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3908 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaacb5 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.588604:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc390f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.588619:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc390f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.588631:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc390f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869698.588680:0:6486:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869698.588703:0:6486:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc390f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.588748:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3908 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacb5 expref: 72 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.588769:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc390f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacb5 expref: 71 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.588778:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99fe821d6f00) 00010000:00010000:3.0:1788869698.588781:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788869698.588786:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9f400, rc 0) 00000100:00100000:3.0:1788869698.589345:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+71:12356:x1875765545229696:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 1126us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869698.589356:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 196 00000100:00100000:1.0:1788869698.600973:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869698.603518:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545229824 00000100:00100000:0.0:1788869698.603534:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545229824 00000100:00100000:0.0:1788869698.603595:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:0.0:1788869698.603605:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+7:2389:x1875765545229824:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869698.603624:0:8401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869698.603647:0:8401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a79fc6b1/0xbead52e175fc3916 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaacbc expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788869698.603673:0:8401:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ffc43, blocks: 0x0 00010000:00010000:0.0:1788869698.603694:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=316s v=(0 0) 00010000:00010000:0.0:1788869698.603698:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869698.603708:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a79fc6b1/0xbead52e175fc3916 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacbc expref: 8 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.603726:0:8401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a79fc6b1/0xbead52e175fc3916 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacbc expref: 8 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.603753:0:8401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04c00, rc 0) 00000100:00100000:0.0:1788869698.603815:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+8:2389:x1875765545229824:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 212us (2859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869698.603822:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:3.0:1788869698.614478:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869698.614556:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545230080 00000100:00100000:0.0:1788869698.614571:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545230080 00000100:00100000:0.0:1788869698.614645:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 197 00000100:00100000:0.0:1788869698.614656:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+71:12356:x1875765545230080:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788869698.614800:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+71:12356:x1875765545230080:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 145us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869698.614807:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 197 00000100:00100000:0.0:1788869698.621372:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869698.621456:0:14581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545230208 00000100:00100000:2.0:1788869698.621474:0:14581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545230208 00000100:00100000:2.0:1788869698.621544:0:14581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:2.0:1788869698.621556:0:14581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf4fff62-1855-4361-a244-1a23eb291d37+8:12356:x1875765545230208:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869698.621575:0:14581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869698.621595:0:14581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2081f99/0xbead52e175fc391d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaacc3 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.621630:0:14581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a79fc6b1/0xbead52e175fc3916 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacbc expref: 9 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.621651:0:14581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869698.621656:0:14581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869698.621662:0:14581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2081f99/0xbead52e175fc391d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacc3 expref: 9 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.621696:0:14581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a79fc6b1/0xbead52e175fc3916 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacbc expref: 9 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.621709:0:14581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a79fc6b1/0xbead52e175fc3916 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacbc expref: 9 pid: 8401 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869698.621738:0:14581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff8729ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14581:1875765554724992:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788869698.621853:0:14581:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae73f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788869698.627611:0:14581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff8729ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14581:1875765554724992:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788869698.627653:0:14581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2081f99/0xbead52e175fc391d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacc3 expref: 9 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.627681:0:14581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0000, rc 0) 00000100:00100000:2.0:1788869698.627748:0:14581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf4fff62-1855-4361-a244-1a23eb291d37+9:12356:x1875765545230208:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 6194us (7314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869698.627758:0:14581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:3.0:1788869698.632028:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869698.632137:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545230336 00000100:00100000:0.0:1788869698.632165:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545230336 00010000:00010000:0.0:1788869698.632223:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a79fc6b1/0xbead52e175fc3916 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacbc expref: 9 pid: 8401 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869698.632303:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 89 00000100:00100000:0.0:1788869698.632313:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89da8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+9:2387:x1875765545230336:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869698.632329:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869698.632351:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a79fc6b1/0xbead52e175fc3916 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacbc expref: 9 pid: 8401 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.632365:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a79fc6b1/0xbead52e175fc3916 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacbc expref: 9 pid: 8401 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.632402:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a79fc6b1/0xbead52e175fc3916 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacbc expref: 9 pid: 8401 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.632418:0:6471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869698.632423:0:6471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869698.632432:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2081f99/0xbead52e175fc391d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacc3 expref: 8 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.632456:0:6471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2081f99/0xbead52e175fc391d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacc3 expref: 8 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.632518:0:6471:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e2081f99/0xbead52e175fc391d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacc3 expref: 8 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869698.632537:0:6471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84024a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6471:1875765554725120:192.168.201.30@tcp:105: 00000100:00100000:0.0:1788869698.632646:0:6471:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff88e3ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788869698.636638:0:6471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84024a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6471:1875765554725120:192.168.201.30@tcp:105: 00010000:00010000:2.0:1788869698.636673:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869698.636751:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89da8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+8:2387:x1875765545230336:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 4437us (4737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869698.636763:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 89 00000100:00100000:0.0:1788869698.638375:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869698.638678:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545230464 00000100:00100000:3.0:1788869698.638695:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545230464 00002000:00100000:3.0:1788869698.638762:0:8404:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff99fe84026a00 x1875765545230464/t0(0) o4->bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp:644/0 lens 504/0 e 0 to 0 dl 1788869709 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788869698.638775:0:8404:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99fe84026a00 with x1875765545230464 ext(0->8) 00002000:00010000:3.0:1788869698.638781:0:8404:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fe84026a00 00000100:00100000:3.0:1788869698.638817:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:3.0:1788869698.638827:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf4fff62-1855-4361-a244-1a23eb291d37+8:2387:x1875765545230464:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788869698.642298:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf4fff62-1855-4361-a244-1a23eb291d37+10:2387:x1875765545230464:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 Request processed in 3459us (3916us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788869698.643479:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00002000:00100000:3.0:1788869698.643513:0:8404:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff99fe84026a00 x1875765545230464/t4294967315(0) o4->bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp:644/0 lens 504/448 e 0 to 0 dl 1788869709 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788869698.643526:0:8404:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99fe84026a00 with x1875765545230464 ext(0->8) 00002000:00010000:3.0:1788869698.643535:0:8404:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fe84026a00 00000100:00100000:3.0:1788869698.645414:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869698.646151:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545230592 00000100:00100000:0.0:1788869698.646162:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545230592 00000100:00100000:0.0:1788869698.646218:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 198 00000100:00100000:0.0:1788869698.646229:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+71:12356:x1875765545230592:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788869698.650189:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1788869698.650215:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00010000:00010000:3.0:1788869698.650284:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3645 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650301:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3645 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650309:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3645 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650315:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869698.650320:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3645 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650326:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3645 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650343:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99ffb89e1900) 00010000:00010000:3.0:1788869698.650346:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869698.650351:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3645 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650357:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3645 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650375:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc364c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650392:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc364c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650396:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc364c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650401:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869698.650403:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc364c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650408:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc364c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650416:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:3.0:1788869698.650418:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869698.650421:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc364c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650426:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc364c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650456:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc368b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650463:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc368b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650468:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc368b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650473:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869698.650482:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc368b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650489:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc368b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650497:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99fe821d6300) 00010000:00010000:3.0:1788869698.650500:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869698.650503:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc368b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650508:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc368b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650525:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc378e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650530:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc378e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650535:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc378e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650540:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869698.650542:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc378e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650548:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc378e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650555:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:3.0:1788869698.650557:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869698.650578:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc378e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650584:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc378e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650596:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc37b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650603:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc37b1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650608:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc37b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650613:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869698.650616:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc37b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650622:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc37b1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650631:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:3.0:1788869698.650633:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869698.650636:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc37b1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650641:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc37b1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650653:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650658:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650670:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650675:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9f600 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869698.650678:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650685:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650694:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:3.0:1788869698.650697:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869698.650699:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37f7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650705:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc37f7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650717:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc38fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650723:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc38fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650728:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc38fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650733:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fc00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869698.650736:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc38fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650753:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc38fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650762:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99fe821d6f00) 00010000:00010000:3.0:1788869698.650764:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788869698.650767:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc38fa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.650773:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc38fa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869698.655408:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869698.655572:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554725248:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788869698.655675:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869698.655751:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554725248 00000100:00100000:3.0:1788869698.655768:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554725248 00000100:00100000:3.0:1788869698.655845:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788869698.655855:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554725248:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1788869698.655985:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00002000:00010000:3.0:1788869698.656007:0:8399:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00000020:00080000:2.0:1788869698.656010:0:6463:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99ff82fbcb40 refcount 2 committed 0 result 0 batchid 5 00002000:00010000:3.0:1788869698.656014:0:8399:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788869699 00002000:00010000:3.0:1788869698.656020:0:8399:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788869698.656023:0:8399:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788869699 -> 1788869699 00002000:00010000:3.0:1788869698.656025:0:8399:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788869698.656105:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3616:x1875765554725248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 251us (430us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788869698.656113:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000020:00080000:2.0:1788869698.656125:0:6463:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99ff85efe000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99ff82fbc3c0 00000020:00080000:2.0:1788869698.656130:0:6463:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99ff85efe600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fe84092000 00000020:00080000:3.0:1788869698.656150:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788869698.656198:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788869698.656575:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554725376:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788869698.656626:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869698.656773:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554725376 00000100:00100000:2.0:1788869698.656779:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554725376 00000100:00100000:2.0:1788869698.656825:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788869698.656831:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8729ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3618:x1875765554725376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788869698.656859:0:8527:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:2.0:1788869698.656909:0:8527:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ffc40, atime: 0x6a9ffc40, ctime: 0x6a9ffc40, blocks: 0x8 00010000:00010000:2.0:1788869698.656920:0:8527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e811ee73/0xbead52e175fc3924 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.656941:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=316s v=(0 0) 00010000:00010000:2.0:1788869698.656945:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869698.656951:0:8527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e811ee73/0xbead52e175fc3924 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.656970:0:8527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e811ee73/0xbead52e175fc3924 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.656996:0:8527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e811ee73/0xbead52e175fc3924 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.657005:0:8527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e811ee73/0xbead52e175fc3924 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.657118:0:8527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788869698.657348:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8729ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3618:x1875765554725376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 515us (724us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788869698.657356:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000004:00080000:2.0:1788869698.657403:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fe84027480/2, rc 0, transno 4294967308 00000100:00100000:2.0:1788869698.657410:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554725376:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788869698.657831:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+19:12356:x1875765545230592:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 Request processed in 11594us (12418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869698.657844:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 198 00000100:00080000:0.0:1788869698.657883:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788869698.657896:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869698.657906:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e811ee73/0xbead52e175fc3924 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.657918:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0800 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869698.657922:0:7425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e811ee73/0xbead52e175fc3924 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.657932:0:7425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e811ee73/0xbead52e175fc3924 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.657954:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e811ee73/0xbead52e175fc3924 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.657962:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e811ee73/0xbead52e175fc3924 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.657982:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869698.657984:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869698.657986:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788869698.658032:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fe84024000/2, rc 0, transno 4294967316 00000100:00100000:0.0:1788869698.658039:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554725248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788869698.671507:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869698.671676:0:14581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545230720 00000100:00100000:0.0:1788869698.671708:0:14581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545230720 00000100:00100000:0.0:1788869698.671781:0:14581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:0.0:1788869698.671795:0:14581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff87299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf4fff62-1855-4361-a244-1a23eb291d37+10:2388:x1875765545230720:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788869698.681210:0:8393:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1788869698.681226:0:8393:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1788869698.682211:0:14581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff87299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf4fff62-1855-4361-a244-1a23eb291d37+7:2388:x1875765545230720:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 Request processed in 10409us (10767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869698.682225:0:14581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:3.0:1788869698.685784:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869698.685962:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545230976 00000100:00100000:0.0:1788869698.685977:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545230976 00000100:00100000:0.0:1788869698.686063:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 199 00000100:00100000:0.0:1788869698.686076:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+19:12356:x1875765545230976:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788869698.686170:0:12967:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869698.686209:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc390f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacb5 expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.686235:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99fe821d6f00) 00010000:00010000:0.0:1788869698.686242:0:12967:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869698.686758:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc392b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.686778:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc392b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.686791:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc392b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869698.687070:0:12967:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e0bfdd6d reply state 00000000eb312b1c transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc392b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.687084:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc392b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.687103:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99fe821d6f00) 00010000:00010000:0.0:1788869698.687106:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869698.687110:0:12967:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869698.687329:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+20:12356:x1875765545230976:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 1253us (1558us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1788869698.687339:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 199 00000100:00100000:2.0:1788869698.693276:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869698.693922:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545231104 00000100:00100000:3.0:1788869698.693935:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545231104 00000100:00100000:3.0:1788869698.694128:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:3.0:1788869698.694139:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8729b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+7:2389:x1875765545231104:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788869698.694537:0:8401:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788869698.694541:0:8401:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788869699 -> 1788869697 00002000:00010000:3.0:1788869698.694543:0:8401:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788869696 00002000:00010000:3.0:1788869698.694545:0:8401:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788869699 -> 1788869697 00002000:00010000:3.0:1788869698.694548:0:8401:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788869698.694628:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8729b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+8:2389:x1875765545231104:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 490us (1389us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788869698.694733:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:2.0:1788869698.696335:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869698.696407:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545231360 00000100:00100000:3.0:1788869698.696419:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545231360 00000100:00100000:3.0:1788869698.696496:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 200 00000100:00100000:3.0:1788869698.696503:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8729aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+20:12356:x1875765545231360:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788869698.696587:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3932 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.696603:0:9496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc38f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaca7 expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.696612:0:9496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3932 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.696653:0:9496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc38f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaca7 expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.696691:0:9496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc38f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaca7 expref: 20 pid: 6486 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869698.696710:0:9496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9496:1875765554725504:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869698.696804:0:9496:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869698.702291:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869698.702368:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545231488 00000100:00100000:1.0:1788869698.702382:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545231488 00000100:00100000:3.0:1788869698.702411:0:9496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9496:1875765554725504:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788869698.702434:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc38f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaca7 expref: 21 pid: 6486 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869698.702504:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 90 00000100:00100000:1.0:1788869698.702516:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84027100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+21:2388:x1875765545231488:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869698.702532:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869698.702540:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc38f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaca7 expref: 21 pid: 6486 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.702555:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc38f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaca7 expref: 21 pid: 6486 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.702587:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc38f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaca7 expref: 21 pid: 6486 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.702592:0:9496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3932 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.702627:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99fe821d6f00) 00010000:00010000:1.0:1788869698.702633:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3932 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.702643:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3932 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.702651:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3932 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.702677:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869698.702876:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84027100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+20:2388:x1875765545231488:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 362us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869698.702885:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 90 00010000:00010000:3.0:1788869698.703764:0:9496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3932 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.703779:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3932 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.703839:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3932 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.703848:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3932 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.703856:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3932 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.703863:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fe00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869698.703932:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3932 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.703943:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3932 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.703970:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99fe821d6f00) 00010000:00010000:3.0:1788869698.703973:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788869698.703978:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3932 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.703986:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3932 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869698.704102:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8729aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+19:12356:x1875765545231360:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 Request processed in 7593us (7769us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788869698.704114:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 200 00000100:00100000:3.0:1788869698.706284:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869698.706370:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545231616 00000100:00100000:1.0:1788869698.706386:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545231616 00000100:00100000:1.0:1788869698.706473:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:1.0:1788869698.706486:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+8:2390:x1875765545231616:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788869698.706545:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b50c0f63/0xbead52e175fc3939 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.706583:0:8400:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2081f99/0xbead52e175fc391d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacc3 expref: 8 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.706593:0:8400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869698.706599:0:8400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788869698.706604:0:8400:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b50c0f63/0xbead52e175fc3939 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.706663:0:8400:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e2081f99/0xbead52e175fc391d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacc3 expref: 8 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.706682:0:8400:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e2081f99/0xbead52e175fc391d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacc3 expref: 8 pid: 14581 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869698.706704:0:8400:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8400:1875765554725632:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788869698.706820:0:8400:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe823206c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869698.710117:0:8400:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8400:1875765554725632:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788869698.710157:0:8400:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b50c0f63/0xbead52e175fc3939 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869698.710350:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869698.710537:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545231744 00000100:00100000:0.0:1788869698.710547:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545231744 00010000:00010000:0.0:1788869698.710676:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e2081f99/0xbead52e175fc391d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacc3 expref: 9 pid: 14581 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869698.710727:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 91 00000100:00100000:0.0:1788869698.710740:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+9:2388:x1875765545231744:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869698.710760:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869698.710787:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e2081f99/0xbead52e175fc391d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacc3 expref: 9 pid: 14581 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.710801:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e2081f99/0xbead52e175fc391d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacc3 expref: 9 pid: 14581 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.710843:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2081f99/0xbead52e175fc391d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacc3 expref: 9 pid: 14581 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.710859:0:9488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869698.710865:0:9488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869698.710872:0:9488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b50c0f63/0xbead52e175fc3939 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.710884:0:9488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b50c0f63/0xbead52e175fc3939 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.710963:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869698.711032:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+8:2388:x1875765545231744:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 293us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869698.711040:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 91 00010000:00010000:3.0:1788869698.711521:0:8400:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b50c0f63/0xbead52e175fc3939 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.711533:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b50c0f63/0xbead52e175fc3939 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.711618:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b50c0f63/0xbead52e175fc3939 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.711628:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b50c0f63/0xbead52e175fc3939 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.711637:0:8400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b50c0f63/0xbead52e175fc3939 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.711657:0:8400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80030c00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869698.711662:0:8400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b50c0f63/0xbead52e175fc3939 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.711673:0:8400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b50c0f63/0xbead52e175fc3939 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.711687:0:8400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b50c0f63/0xbead52e175fc3939 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869698.711696:0:8400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b50c0f63/0xbead52e175fc3939 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869698.711799:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+7:2390:x1875765545231616:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 Request processed in 5315us (5545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869698.711808:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:3.0:1788869698.713375:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869698.713430:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545232000 00000100:00100000:1.0:1788869698.713455:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545232000 00000100:00100000:1.0:1788869698.713523:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 201 00000100:00100000:1.0:1788869698.713533:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+19:12356:x1875765545232000:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788869698.713637:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3940 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.713728:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3787 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac4c expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.713741:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3940 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.713788:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3787 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac4c expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.713804:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3787 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac4c expref: 19 pid: 6486 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869698.713838:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6485:1875765554725760:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788869698.713996:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82320b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869698.722554:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869698.722589:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545232128 00000100:00100000:2.0:1788869698.722602:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545232128 00000100:00100000:1.0:1788869698.722624:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6485:1875765554725760:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788869698.722658:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3940 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.722666:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3787 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac4c expref: 20 pid: 6486 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869698.722717:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 92 00000100:00100000:2.0:1788869698.722730:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+20:2387:x1875765545232128:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869698.722751:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869698.722760:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3787 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac4c expref: 20 pid: 6486 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.722786:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3787 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac4c expref: 20 pid: 6486 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.722817:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3787 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac4c expref: 20 pid: 6486 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.722835:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:2.0:1788869698.722842:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3940 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.722864:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3940 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.722882:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3940 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.722916:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869698.722983:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+19:2387:x1875765545232128:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 256us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869698.722992:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 92 00010000:00010000:1.0:1788869698.723158:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3940 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.723167:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3940 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.723484:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3947 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.723501:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3901 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacae expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.723512:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3947 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.723556:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3901 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacae expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.723573:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3901 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacae expref: 19 pid: 6484 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869698.723604:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6485:1875765554725888:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788869698.723678:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe823203c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869698.741166:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869698.741434:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6485:1875765554725888:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869698.741483:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3947 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869698.741634:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545232256 00000100:00100000:0.0:1788869698.741643:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545232256 00010000:00010000:0.0:1788869698.741688:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3901 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacae expref: 20 pid: 6484 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869698.741730:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93 00000100:00100000:0.0:1788869698.741741:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8399b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+20:2388:x1875765545232256:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869698.741759:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869698.741766:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3901 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacae expref: 20 pid: 6484 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.741794:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3901 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacae expref: 20 pid: 6484 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.741823:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3901 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacae expref: 20 pid: 6484 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.741842:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99fe821d6f00) 00010000:00010000:0.0:1788869698.741847:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3947 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.741859:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3947 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.741867:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3947 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869698.741894:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869698.741967:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8399b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+19:2388:x1875765545232256:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 227us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869698.741975:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93 00010000:00010000:1.0:1788869698.742149:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3947 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.742156:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3947 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788869698.742327:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1788869698.742478:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1788869698.742516:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1788869698.742700:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8399b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6485:1875765554726016:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788869698.742770:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869698.742805:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe823203c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869698.743401:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554726016 00000100:00100000:0.0:1788869698.743410:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554726016 00000100:00100000:0.0:1788869698.743556:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788869698.743566:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6485:x1875765554726016:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788869698.743682:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6485:x1875765554726016:12345-0@lo:1000:mdt00_001.0 Request processed in 117us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869698.743691:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788869698.743782:0:6485:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1788869698.743789:0:6485:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fe84024000, transno 4294967316 00000100:00100000:1.0:1788869698.743807:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8399b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6485:1875765554726016:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788869698.743980:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1788869698.744051:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8399b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6485:1875765554726144:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788869698.744091:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869698.746836:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8862f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869698.746870:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554726144 00000100:00100000:3.0:1788869698.746880:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554726144 00000100:00100000:3.0:1788869698.746929:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788869698.746939:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8399a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6485:x1875765554726144:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788869698.747199:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8399a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6485:x1875765554726144:12345-0@lo:1000:mdt00_001.0 Request processed in 261us (3106us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788869698.747208:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788869698.748809:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8399b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6485:1875765554726144:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788869698.748884:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3947 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.748916:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3947 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.748925:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3947 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.748932:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869698.748938:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3947 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.748948:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3947 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.748969:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99fe821d6f00) 00010000:00010000:1.0:1788869698.748973:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869698.748979:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3947 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.748985:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031a00/0xbead52e175fc3947 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.749014:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc387c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.749020:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc387c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.749026:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc387c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.749031:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9e800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869698.749040:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc387c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.749046:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc387c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.749054:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:1.0:1788869698.749056:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869698.749059:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc387c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.749066:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc387c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.749095:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc394e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.749114:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3898 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac92 expref: 22 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.749124:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc394e lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.749171:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3898 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac92 expref: 22 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.749188:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3898 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac92 expref: 22 pid: 12967 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869698.749205:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83999500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6485:1875765554726272:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788869698.749339:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8862f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869698.753849:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869698.754361:0:9487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545232384 00000100:00100000:2.0:1788869698.754373:0:9487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545232384 00010000:00010000:2.0:1788869698.754435:0:9487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3898 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac92 expref: 23 pid: 12967 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869698.754491:0:9487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94 00000100:00100000:2.0:1788869698.754505:0:9487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4fff62-1855-4361-a244-1a23eb291d37+23:2387:x1875765545232384:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869698.754536:0:9487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869698.754545:0:9487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3898 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac92 expref: 23 pid: 12967 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.754563:0:9487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3898 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac92 expref: 23 pid: 12967 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.754602:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:2.0:1788869698.754609:0:9487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc394e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.754621:0:9487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc394e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.754631:0:9487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc394e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.754658:0:9487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869698.754728:0:9487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4fff62-1855-4361-a244-1a23eb291d37+23:2387:x1875765545232384:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 226us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869698.754737:0:9487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94 00010000:00010000:2.0:1788869698.756216:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3898 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaac92 expref: 22 pid: 12967 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869698.756271:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83999500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6485:1875765554726272:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788869698.756301:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc394e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.756313:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc394e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.756329:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc394e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.756344:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc394e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.756351:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc394e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.756360:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc394e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.756366:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80030000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869698.756372:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc394e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.756379:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc394e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.756395:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:2.0:1788869698.756398:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869698.756403:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc394e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.756410:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc394e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.756421:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3940 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.756428:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3940 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.756452:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3940 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.756458:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869698.756461:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3940 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.756468:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3940 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.756477:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ffb89e1300) 00010000:00010000:2.0:1788869698.756480:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788869698.756483:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3940 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.756489:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3940 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869698.756720:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+21:12356:x1875765545232000:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 43186us (43352us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788869698.756731:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 201 00000020:00080000:2.0:1788869698.756737:0:6485:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788869698.757278:0:13761:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788869698.757285:0:13761:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788869698.757788:0:13761:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1788869698.757798:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788869698.762688:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869698.762796:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545232640 00000100:00100000:1.0:1788869698.762811:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545232640 00000100:00100000:1.0:1788869698.762882:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:1.0:1788869698.762895:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae5b9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+21:12356:x1875765545232640:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788869698.763460:0:6488:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788869698.763510:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:1.0:1788869698.763553:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3955 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.763576:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3955 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.763591:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3955 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.763601:0:6488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3955 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.763608:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3955 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.763615:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3955 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869698.763722:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788869698.763833:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae5b9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+23:12356:x1875765545232640:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 938us (1158us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788869698.763858:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 50 00000020:00080000:1.0:1788869698.763864:0:6488:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788869698.764561:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869698.764571:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3955 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.764581:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80030a00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869698.764586:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3955 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.764609:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3955 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.764625:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99fe821d6f00) 00010000:00010000:2.0:1788869698.764629:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788869698.764635:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3955 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.764641:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030a00/0xbead52e175fc3955 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869698.764656:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869698.764658:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869698.764659:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869698.968601:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554726400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869698.968729:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869698.969030:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554726400 00000100:00100000:1.0:1788869698.969042:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554726400 00000100:00100000:1.0:1788869698.969122:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788869698.969134:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554726400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788869698.969184:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788869698.970199:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554726400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1064us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869698.970210:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788869698.970366:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554726400:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788869699.608777:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788869700.353811:0:14671:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788869700.353828:0:14671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788869700.353854:0:14671:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788869700.353861:0:14671:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788869700.445617:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869700.445669:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545232896 00000100:00100000:3.0:1788869700.445683:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545232896 00000100:00100000:3.0:1788869700.445769:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 202 00000100:00100000:3.0:1788869700.445781:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+23:12375:x1875765545232896:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869700.445812:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869700.445839:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc395c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaacca expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.445974:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3963 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.445994:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3963 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.446010:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3963 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869700.446024:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788869700.446149:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc395c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacca expref: 26 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.446165:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3963 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacca expref: 25 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.446172:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:3.0:1788869700.446175:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788869700.446178:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9fc00, rc 0) 00000100:00100000:3.0:1788869700.447657:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+25:12375:x1875765545232896:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 465us (642us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788869700.447680:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 202 00000100:00080000:3.0:1788869700.447728:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869700.449481:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869700.449768:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545233024 00000100:00100000:3.0:1788869700.449781:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545233024 00000100:00100000:3.0:1788869700.449849:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 203 00000100:00100000:3.0:1788869700.449861:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+25:12375:x1875765545233024:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:3.0:1788869700.449960:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3971 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.449983:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3971 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.449998:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3971 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.450017:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3978 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.450025:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3978 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.450039:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3978 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.450140:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc397f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.450148:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc397f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.450155:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc397f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869700.450209:0:9496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc397f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.450224:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3971 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.450232:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3971 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.450240:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3971 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.452367:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9f600 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869700.452377:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3971 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.452389:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3971 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.452408:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:3.0:1788869700.452418:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869700.452424:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3971 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.452432:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3971 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.452459:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3978 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.452467:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3978 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.452474:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3978 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.452481:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9ee00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869700.452484:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3978 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.452491:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3978 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.452499:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99ff88bbfb00) 00010000:00010000:3.0:1788869700.452501:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869700.452504:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3978 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.452509:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3978 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.452537:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc397f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.452548:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc397f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.452553:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc397f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.452557:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9e800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869700.452560:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc397f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.452564:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc397f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.452571:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ff88bbfe00) 00010000:00010000:3.0:1788869700.452573:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869700.452576:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc397f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.452581:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc397f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869700.452706:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+25:12375:x1875765545233024:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 2841us (3231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869700.452718:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 203 00000100:00100000:2.0:1788869700.476042:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869700.476211:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545233280 00000100:00100000:1.0:1788869700.476222:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545233280 00000100:00100000:2.0:1788869700.476390:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 204 00000100:00100000:2.0:1788869700.476404:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbf924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+25:12378:x1875765545233280:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1788869700.476499:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869700.476530:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3986 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaacd1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.476615:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc398d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.476630:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc398d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.476640:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc398d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.476674:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3994 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.476680:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.476684:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.476801:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc399b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.476806:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc399b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.476810:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc399b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869700.476819:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788869700.476895:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc398d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.476901:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc398d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.476906:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc398d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.476910:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869700.476913:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc398d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.476938:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc398d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.476951:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:2.0:1788869700.476954:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869700.476958:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc398d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.476962:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc398d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.476974:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.476977:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3994 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.476981:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3994 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.476984:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869700.476986:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3994 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.476989:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3994 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.476992:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99ff98fad100) 00010000:00010000:2.0:1788869700.476993:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869700.476995:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3994 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.477005:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3994 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.477041:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3986 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacd1 expref: 28 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.477053:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc399b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacd1 expref: 27 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.477061:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ff98fad600) 00010000:00010000:2.0:1788869700.477064:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869700.477067:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0200, rc 0) 00000100:00100000:2.0:1788869700.477149:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbf924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+27:12378:x1875765545233280:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 748us (1119us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788869700.477157:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 204 00000100:00100000:3.0:1788869700.479350:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869700.479428:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545233408 00000100:00100000:0.0:1788869700.479440:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545233408 00000100:00100000:0.0:1788869700.479517:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 205 00000100:00100000:0.0:1788869700.479528:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+27:12378:x1875765545233408:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:0.0:1788869700.479608:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc39a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.479623:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc39a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.479632:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc39a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.479667:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc39a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.479673:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc39a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.479677:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc39a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.479681:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869700.479684:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc39a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.479688:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc39a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.479697:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ff98fad600) 00010000:00010000:0.0:1788869700.479698:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788869700.479715:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc39a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.479720:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc39a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869700.479789:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+27:12378:x1875765545233408:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 263us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869700.479796:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 205 00000100:00100000:0.0:1788869700.480913:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869700.481027:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545233664 00000100:00100000:3.0:1788869700.481036:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545233664 00000100:00100000:3.0:1788869700.481083:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:3.0:1788869700.481094:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+27:12378:x1875765545233664:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1788869700.481383:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+28:12378:x1875765545233664:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 291us (473us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1788869700.481391:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:3.0:1788869700.493914:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869700.494202:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545233920 00000100:00100000:0.0:1788869700.494242:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545233920 00000100:00100000:0.0:1788869700.494358:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 206 00000100:00100000:0.0:1788869700.494370:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+28:11902:x1875765545233920:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1788869700.494401:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869700.494438:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc39b0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaacd8 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.494691:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc39b7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.494707:0:9496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc399b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacd1 expref: 29 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.494714:0:9496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc39b7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.494747:0:9496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc399b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacd1 expref: 29 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.494779:0:9496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc399b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacd1 expref: 29 pid: 6486 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869700.494792:0:9496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84025500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9496:1875765554726528:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788869700.494989:0:9496:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff88e3ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869700.496645:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869700.496759:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545234048 00000100:00100000:2.0:1788869700.496770:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545234048 00000100:00100000:3.0:1788869700.496798:0:9496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84025500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9496:1875765554726528:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788869700.496810:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc399b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacd1 expref: 30 pid: 6486 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.496826:0:9496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc39b7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869700.496887:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 95 00000100:00100000:2.0:1788869700.496897:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84024380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+30:2387:x1875765545234048:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869700.496914:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869700.496922:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc399b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacd1 expref: 30 pid: 6486 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.496965:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc399b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacd1 expref: 30 pid: 6486 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.496991:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc399b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacd1 expref: 30 pid: 6486 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.497009:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ff98fad600) 00010000:00010000:2.0:1788869700.497014:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc39b7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.497024:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc39b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.497033:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc39b7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.497068:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869700.497131:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84024380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+29:2387:x1875765545234048:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 235us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869700.497141:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 95 00010000:00010000:3.0:1788869700.497196:0:9496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc39b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.497205:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc39b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869700.497227:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788869700.497418:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05000/0xbead52e175fc39b0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacd8 expref: 30 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.497455:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc39b7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacd8 expref: 29 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.497465:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ff98fad600) 00010000:00010000:3.0:1788869700.497469:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788869700.497472:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04000, rc 0) 00000100:00100000:3.0:1788869700.497501:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+29:11902:x1875765545233920:12345-192.168.201.30@tcp:101:bash.0 Request processed in 3133us (3598us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1788869700.497509:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 206 00000100:00100000:3.0:1788869700.498996:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869700.499042:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545234176 00000100:00100000:2.0:1788869700.499112:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545234176 00000100:00100000:2.0:1788869700.499169:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 207 00000100:00100000:2.0:1788869700.499178:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+29:11902:x1875765545234176:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1788869700.499202:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869700.499225:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc39c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaacdf expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.499315:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc39cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.499330:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc39cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.499341:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc39cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.499459:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc39c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacdf expref: 31 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.499478:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc39cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacdf expref: 30 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.499487:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ff98fad600) 00010000:00010000:2.0:1788869700.499490:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788869700.499492:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0400, rc 0) 00000100:00100000:2.0:1788869700.499531:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+30:11902:x1875765545234176:12345-192.168.201.30@tcp:101:bash.0 Request processed in 356us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869700.499536:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 207 00000100:00100000:1.0:1788869700.500983:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869700.501490:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545234432 00000100:00100000:0.0:1788869700.501503:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545234432 00000100:00100000:0.0:1788869700.501568:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 208 00000100:00100000:0.0:1788869700.501578:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+30:11902:x1875765545234432:12345-192.168.201.30@tcp:36:bash.0 00010000:00010000:0.0:1788869700.501816:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc39d3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.501831:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc39d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.501840:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc39d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869700.501880:0:12967:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1788869700.501897:0:12967:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000650207be reply state 00000000c846a0ce transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc39d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.501908:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc39d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.501913:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ff98fad600) 00010000:00010000:0.0:1788869700.501915:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869700.501947:0:12967:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788869700.501978:0:12967:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1788869700.502074:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+34:11902:x1875765545234432:12345-192.168.201.30@tcp:36:bash.0 Request processed in 498us (1097us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788869700.502082:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 208 00000020:00080000:0.0:1788869700.502088:0:12967:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788869700.503746:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869700.503787:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545234560 00000100:00100000:3.0:1788869700.503797:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545234560 00000100:00100000:3.0:1788869700.503843:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 209 00000100:00100000:3.0:1788869700.503850:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+34:11902:x1875765545234560:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1788869700.503869:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869700.503886:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc39da lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaace6 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.503934:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc39da lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaace6 expref: 35 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.503950:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc39da lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaace6 expref: 35 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.503970:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ff98fad600) 00010000:00010000:3.0:1788869700.503973:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788869700.503977:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9f400, rc 0) 00000100:00100000:3.0:1788869700.504643:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+35:11902:x1875765545234560:12345-192.168.201.30@tcp:101:bash.0 Request processed in 790us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869700.504651:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 209 00000100:00100000:2.0:1788869700.509030:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869700.509168:0:14581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545234688 00000100:00100000:0.0:1788869700.509182:0:14581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545234688 00000100:00080000:3.0:1788869700.509312:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869700.509367:0:14581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:0.0:1788869700.509377:0:14581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf4fff62-1855-4361-a244-1a23eb291d37+7:11902:x1875765545234688:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1788869700.509397:0:14581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869700.509420:0:14581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc39e1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaced expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788869700.509471:0:14581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ffc41, atime: 0x6a9ffc40, ctime: 0x6a9ffc41, blocks: 0x8 00010000:00010000:0.0:1788869700.509503:0:14581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=318s v=(0 0) 00010000:00010000:0.0:1788869700.509508:0:14581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869700.509519:0:14581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc39e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaced expref: 8 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.509541:0:14581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc39e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaced expref: 8 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.509556:0:14581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04400, rc 0) 00000100:00100000:0.0:1788869700.509637:0:14581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf4fff62-1855-4361-a244-1a23eb291d37+8:11902:x1875765545234688:12345-192.168.201.30@tcp:101:bash.0 Request processed in 260us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869700.509666:0:14581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:1.0:1788869700.514544:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869700.514606:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545234816 00000100:00100000:3.0:1788869700.514620:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545234816 00002000:00010000:3.0:1788869700.514676:0:8406:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:3.0:1788869700.514682:0:8406:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99fe8399bb80 with x1875765545234816 ext(0->18446744073709551615) 00002000:00010000:3.0:1788869700.514698:0:8406:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fe8399bb80. 00000100:00100000:3.0:1788869700.514740:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:3.0:1788869700.514752:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8399bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf4fff62-1855-4361-a244-1a23eb291d37+8:2388:x1875765545234816:12345-192.168.201.30@tcp:10:bash.0 00002000:00010000:2.0:1788869700.515700:0:8406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788869700.515706:0:8406:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788869697 -> 1788869701 00002000:00010000:2.0:1788869700.515708:0:8406:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1788869696 -> 1788869696 00002000:00010000:2.0:1788869700.515710:0:8406:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788869697 -> 1788869701 00002000:00010000:2.0:1788869700.515711:0:8406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788869700.515825:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8399bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf4fff62-1855-4361-a244-1a23eb291d37+9:2388:x1875765545234816:12345-192.168.201.30@tcp:10:bash.0 Request processed in 1073us (1291us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788869700.515837:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00002000:00010000:2.0:1788869700.515841:0:8406:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1788869700.515844:0:8406:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99fe8399bb80 with x1875765545234816 ext(0->18446744073709551615) 00002000:00010000:2.0:1788869700.515849:0:8406:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fe8399bb80. 00000100:00100000:3.0:1788869700.573681:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869700.578330:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545234944 00000100:00100000:2.0:1788869700.578352:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545234944 00000100:00100000:2.0:1788869700.578468:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 210 00000100:00100000:2.0:1788869700.578482:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+35:12392:x1875765545234944:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:2.0:1788869700.578589:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc39e8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.578614:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc39e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.578629:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc39e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.578648:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc39ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.578656:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc39ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.578663:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc39ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.578755:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc39f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.578791:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc39f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.578799:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc39f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869700.578855:0:6486:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc39f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.578869:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc39e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.578875:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc39e8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.578883:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc39e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.578890:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1e00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869700.578895:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc39e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.578903:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc39e8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.578917:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:2.0:1788869700.578921:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869700.579081:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc39e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.579089:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc39e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.579112:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc39ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.579118:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc39ef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.579125:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc39ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.579130:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869700.579133:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc39ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.579138:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc39ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.579159:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99ff98fad100) 00010000:00010000:2.0:1788869700.579162:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869700.579168:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc39ef lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.579175:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc39ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.579190:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc39f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.579197:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc39f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.579202:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc39f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.579214:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869700.579217:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc39f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.579223:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc39f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.579231:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ff98fad600) 00010000:00010000:2.0:1788869700.579233:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869700.579235:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc39f6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.579241:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc39f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869700.579425:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+35:12392:x1875765545234944:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 945us (8007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869700.579434:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 210 00000100:00100000:0.0:1788869700.617378:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869700.617610:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545235200 00000100:00100000:3.0:1788869700.617625:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545235200 00000100:00100000:3.0:1788869700.617705:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 211 00000100:00100000:3.0:1788869700.617717:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+35:12395:x1875765545235200:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869700.617748:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869700.617777:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc39fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaacf4 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.617867:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3a04 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.617884:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3a04 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.617897:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3a04 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.617914:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3a0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.617922:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3a0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.617983:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3a0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.618121:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3a12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.618132:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3a12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.618157:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3a12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869700.618170:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788869700.618289:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3a04 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.618298:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3a04 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.618305:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3a04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.618312:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9ee00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869700.618317:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3a04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.618325:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3a04 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.618342:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:3.0:1788869700.618345:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869700.618352:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3a04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.618359:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3a04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.618376:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3a0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.618382:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3a0b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.618395:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3a0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.618401:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9f600 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869700.618404:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3a0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.618410:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3a0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.618419:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99ff88bbfe00) 00010000:00010000:3.0:1788869700.618561:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869700.618566:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3a0b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.618572:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3a0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.618631:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc39fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacf4 expref: 38 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.618647:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3a12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacf4 expref: 37 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.618656:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ff98fad600) 00010000:00010000:3.0:1788869700.618658:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788869700.618662:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9fe00, rc 0) 00000100:00100000:3.0:1788869700.618787:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+37:12395:x1875765545235200:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1072us (1538us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788869700.618808:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 211 00000100:00100000:1.0:1788869700.622540:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869700.622664:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545235328 00000100:00100000:3.0:1788869700.622676:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545235328 00000100:00100000:3.0:1788869700.622744:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 212 00000100:00100000:3.0:1788869700.622755:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8399b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+37:12395:x1875765545235328:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:3.0:1788869700.622845:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.622869:0:9496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc39b7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacd8 expref: 37 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.622879:0:9496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a20 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.622920:0:9496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc39b7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacd8 expref: 37 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.622947:0:9496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc39b7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacd8 expref: 37 pid: 9496 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869700.622964:0:9496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84019500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9496:1875765554726656:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869700.623072:0:9496:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2480 going to sleep for 11 seconds 00000100:00100000:3.0:1788869700.627745:0:9496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84019500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9496:1875765554726656:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869700.627784:0:9496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869700.629017:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869700.629111:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545235584 00000100:00100000:3.0:1788869700.629140:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545235584 00000100:00100000:3.0:1788869700.629207:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:3.0:1788869700.629218:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+38:6153:x1875765545235584:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788869700.629787:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+39:6153:x1875765545235584:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 569us (775us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788869700.629794:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:1.0:1788869700.632224:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869700.632609:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545235712 00000100:00100000:3.0:1788869700.632622:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545235712 00010000:00010000:3.0:1788869700.632678:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc39b7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacd8 expref: 39 pid: 9496 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869700.632768:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 96 00000100:00100000:3.0:1788869700.632780:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89dab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+39:2387:x1875765545235712:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869700.632803:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869700.632812:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc39b7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacd8 expref: 39 pid: 9496 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.632829:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc39b7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacd8 expref: 39 pid: 9496 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.632858:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc39b7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacd8 expref: 39 pid: 9496 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.632877:0:9488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ff98fad600) 00010000:00010000:3.0:1788869700.632885:0:9488:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.632919:0:9488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.632942:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a20 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.632980:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869700.633090:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89dab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+38:2387:x1875765545235712:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 311us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869700.633100:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 96 00010000:00010000:0.0:1788869700.633339:0:9496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.633349:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.633399:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.633407:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.633414:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.633429:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869700.633435:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.633452:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.633464:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ff98fad600) 00010000:00010000:0.0:1788869700.633468:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788869700.633472:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a20 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.633479:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869700.633542:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8399b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+37:12395:x1875765545235328:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 10789us (11015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869700.633552:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 212 00010000:00010000:1.0:1788869700.636167:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869700.636522:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869700.636609:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545235968 00000100:00100000:3.0:1788869700.636623:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545235968 00000100:00100000:3.0:1788869700.636728:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:3.0:1788869700.636741:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+37:12395:x1875765545235968:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1788869700.637044:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+38:12395:x1875765545235968:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 305us (528us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788869700.637053:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:1.0:1788869700.689656:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869700.689778:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545236224 00000100:00100000:2.0:1788869700.689792:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545236224 00000100:00100000:2.0:1788869700.689878:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 213 00000100:00100000:2.0:1788869700.689891:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+38:12406:x1875765545236224:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:2.0:1788869700.689934:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869700.689962:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3a27 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaacfb expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690057:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3a2e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690099:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3a2e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690112:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3a2e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690131:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3a35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690139:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3a35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690145:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3a35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690341:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc3a3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690351:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc3a3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690359:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc3a3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869700.690371:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788869700.690479:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3a2e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690488:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3a2e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690495:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3a2e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690511:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1e00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869700.690516:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3a2e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690526:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3a2e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690540:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:2.0:1788869700.690543:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869700.690549:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3a2e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690557:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3a2e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690573:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3a35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690579:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3a35 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690586:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3a35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690591:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0c00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869700.690594:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3a35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690600:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3a35 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690619:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99ff98fad100) 00010000:00010000:2.0:1788869700.690622:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869700.690625:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3a35 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690632:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3a35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690682:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3a27 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacfb expref: 41 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690697:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc3a3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacfb expref: 40 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.690705:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ff98fad600) 00010000:00010000:2.0:1788869700.690708:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869700.690710:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0800, rc 0) 00000100:00100000:2.0:1788869700.690785:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+40:12406:x1875765545236224:12345-192.168.201.30@tcp:101:cat.0 Request processed in 897us (1146us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788869700.690795:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 213 00000100:00100000:2.0:1788869700.696074:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869700.696175:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545236480 00000100:00100000:1.0:1788869700.696189:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545236480 00000100:00100000:1.0:1788869700.696303:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:1.0:1788869700.696317:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+40:12406:x1875765545236480:12345-192.168.201.30@tcp:35:cat.0 00000100:00100000:1.0:1788869700.696748:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+41:12406:x1875765545236480:12345-192.168.201.30@tcp:35:cat.0 Request processed in 433us (688us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788869700.696757:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:0.0:1788869700.712754:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869700.712909:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545236736 00000100:00100000:3.0:1788869700.713113:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545236736 00000100:00100000:3.0:1788869700.713196:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 214 00000100:00100000:3.0:1788869700.713208:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+41:12407:x1875765545236736:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1788869700.713308:0:12967:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788869700.713348:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc39da lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaace6 expref: 41 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.713378:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc3a3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacfb expref: 40 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.713416:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3a12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacf4 expref: 39 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.713555:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc39cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacdf expref: 38 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.713568:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ff98fad600) 00010000:00010000:3.0:1788869700.713574:0:12967:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869700.713601:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3a4a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.713616:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3a4a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.713626:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3a4a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.713644:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc3a51 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.713652:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc3a51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.713659:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc3a51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.713758:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a58 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.713767:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.713781:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788869700.714386:0:12967:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1788869700.714398:0:12967:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 318641144292ns, next at 319641140511ns, rc = 0 00010000:00010000:3.0:1788869700.714471:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3a5f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.714483:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3a5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.714492:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3a5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.714501:0:12967:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3a5f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.714508:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3a5f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.714515:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3a5f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.714538:0:12967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869700.714562:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.714568:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a58 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.714574:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a58 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.714589:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869700.714594:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a58 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.714602:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a58 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.714612:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ff98fad600) 00010000:00010000:3.0:1788869700.714615:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788869700.714619:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a58 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.714625:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3a58 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.714647:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3a4a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.714653:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3a4a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.714660:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3a4a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.714665:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869700.714669:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3a4a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.714675:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3a4a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.714694:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:3.0:1788869700.714696:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869700.714836:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3a4a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.714844:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3a4a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869700.714856:0:12967:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000088c2aa50 reply state 0000000013a75691 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc3a51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.714868:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc3a51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.714875:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99ff88bbfe00) 00010000:00010000:3.0:1788869700.714877:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788869700.714880:0:12967:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788869700.715110:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+39:12407:x1875765545236736:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1901us (2369us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788869700.715119:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 214 00010000:00010000:2.0:1788869700.715283:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869700.715291:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3a5f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.715299:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9e800 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869700.715302:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3a5f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.715320:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3a5f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.715331:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ff98fad600) 00010000:00010000:2.0:1788869700.715333:0:6473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788869700.715336:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3a5f lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.715342:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3a5f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.715353:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869700.715354:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869700.715356:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869700.752397:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869700.752539:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545236992 00000100:00100000:0.0:1788869700.752553:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545236992 00000100:00100000:0.0:1788869700.752644:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 215 00000100:00100000:0.0:1788869700.752656:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+39:12412:x1875765545236992:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1788869700.752691:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869700.752721:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc3a66 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaad02 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.752861:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc3a6d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.752880:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc3a6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.752894:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc3a6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.752906:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3a74 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.752913:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3a74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.752921:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3a74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788869700.753402:0:9496:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788869700.753860:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3a7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.753873:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3a7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.753882:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3a7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.753921:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc3a6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.754111:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc3a6d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.754120:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc3a6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.754127:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869700.754132:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc3a6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.754141:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc3a6d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.754158:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:0.0:1788869700.754161:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869700.754167:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc3a6d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.754191:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc3a6d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869700.754209:0:9496:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000046a898ea reply state 0000000076181728 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3a74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.754221:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3a74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869700.754228:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99ff88bbfe00) 00010000:00010000:0.0:1788869700.754230:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869700.754233:0:9496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788869700.754645:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04200/0xbead52e175fc3a66 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad02 expref: 42 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.754668:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3a7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad02 expref: 41 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869700.754676:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99fe821d6800) 00010000:00010000:2.0:1788869700.754679:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869700.754682:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04e00, rc 0) 00000100:00100000:2.0:1788869700.754780:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+42:12412:x1875765545236992:12345-192.168.201.30@tcp:101:bash.0 Request processed in 2125us (2399us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788869700.754791:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 215 00000100:00100000:1.0:1788869700.758592:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869700.758706:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545237120 00000100:00100000:3.0:1788869700.758719:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545237120 00000100:00100000:3.0:1788869700.758877:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:3.0:1788869700.758891:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8399ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+7:2388:x1875765545237120:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1788869700.758914:0:8401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869700.758960:0:8401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc3a89 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaad09 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869700.758994:0:8401:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869700.759041:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=318s v=(0 0) 00010000:00010000:3.0:1788869700.759047:0:8401:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869700.759059:0:8401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc3a89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad09 expref: 8 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.759082:0:8401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc3a89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad09 expref: 8 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.759100:0:8401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9fe00, rc 0) 00000100:00100000:3.0:1788869700.759213:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8399ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+8:2388:x1875765545237120:12345-192.168.201.30@tcp:101:bash.0 Request processed in 325us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869700.759222:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00080000:0.0:1788869700.760614:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869700.762661:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869700.763088:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545237248 00000100:00100000:3.0:1788869700.763111:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545237248 00000100:00100000:3.0:1788869700.763186:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:3.0:1788869700.763199:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8400ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+8:12412:x1875765545237248:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1788869700.763224:0:8400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869700.766362:0:8400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7b97b93/0xbead52e175fc3a90 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaad10 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.766459:0:8400:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc3a89 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad09 expref: 9 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.766472:0:8400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869700.766478:0:8400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869700.766485:0:8400:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7b97b93/0xbead52e175fc3a90 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad10 expref: 9 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.766568:0:8400:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc3a89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad09 expref: 9 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.766591:0:8400:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc3a89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad09 expref: 9 pid: 8401 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869700.766614:0:8400:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84019500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8400:1875765554726784:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869700.766759:0:8400:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869700.769537:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869700.769570:0:8400:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84019500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8400:1875765554726784:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869700.769618:0:8400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a7b97b93/0xbead52e175fc3a90 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad10 expref: 9 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.769646:0:8400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9f400, rc 0) 00000100:00100000:3.0:1788869700.769725:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8400ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+9:12412:x1875765545237248:12345-192.168.201.30@tcp:101:bash.0 Request processed in 6528us (7078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869700.769736:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:1.0:1788869700.769843:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545237376 00000100:00100000:1.0:1788869700.769853:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545237376 00010000:00010000:1.0:1788869700.769897:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc3a89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad09 expref: 9 pid: 8401 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869700.770018:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 97 00000100:00100000:1.0:1788869700.770031:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+9:2388:x1875765545237376:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869700.770052:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869700.770084:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc3a89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad09 expref: 9 pid: 8401 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869700.770099:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc3a89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad09 expref: 9 pid: 8401 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869700.770129:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071b8f707/0xbead52e175fc3a89 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad09 expref: 9 pid: 8401 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869700.770150:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869700.770156:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869700.770167:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7b97b93/0xbead52e175fc3a90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad10 expref: 8 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869700.770205:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7b97b93/0xbead52e175fc3a90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad10 expref: 8 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869700.770291:0:6470:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a7b97b93/0xbead52e175fc3a90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad10 expref: 8 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869700.770308:0:6470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83999f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6470:1875765554726912:192.168.201.30@tcp:105: 00000100:00100000:1.0:1788869700.770527:0:6470:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe832af9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869700.773781:0:6470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83999f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6470:1875765554726912:192.168.201.30@tcp:105: 00010000:00010000:1.0:1788869700.773815:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869700.773895:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+8:2388:x1875765545237376:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 3865us (4371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869700.773908:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 97 00000100:00100000:2.0:1788869700.775654:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869700.775739:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545237632 00000100:00100000:1.0:1788869700.775751:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545237632 00000100:00100000:1.0:1788869700.775820:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:1.0:1788869700.775832:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+42:12412:x1875765545237632:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:1.0:1788869700.776202:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+43:12412:x1875765545237632:12345-192.168.201.30@tcp:35:bash.0 Request processed in 370us (560us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788869700.776210:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:2.0:1788869700.982642:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869700.983982:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545237760 00000100:00100000:3.0:1788869700.984000:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545237760 00000100:00100000:3.0:1788869700.984155:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 216 00000100:00100000:3.0:1788869700.984389:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+43:12429:x1875765545237760:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869700.984424:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869700.984462:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3a97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaad17 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.984572:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3a9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.984590:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3a9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.984606:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3a9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869700.984663:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788869700.984668:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869700.984693:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3a9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.984722:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3a97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad17 expref: 45 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.984745:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3a9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad17 expref: 44 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869700.984755:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:3.0:1788869700.984758:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869700.984763:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9ee00, rc 0) 00000100:00100000:3.0:1788869700.984854:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+44:12429:x1875765545237760:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 470us (2222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869700.984861:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 216 00000100:00100000:2.0:1788869701.008570:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869701.008658:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545238016 00000100:00100000:3.0:1788869701.008670:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545238016 00000100:00100000:3.0:1788869701.008769:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 217 00000100:00100000:3.0:1788869701.008781:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+44:12429:x1875765545238016:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869701.008810:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869701.008839:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3aa5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaad1e expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.008992:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3aac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.009010:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3aac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.009024:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3aac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869701.009043:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788869701.009519:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3aa5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad1e expref: 47 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.009546:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3aac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad1e expref: 46 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.009557:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99fe821d6800) 00010000:00010000:3.0:1788869701.009560:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869701.009565:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9fe00, rc 0) 00000100:00100000:3.0:1788869701.009654:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+46:12429:x1875765545238016:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 875us (1097us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1788869701.009663:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 217 00000100:00100000:2.0:1788869701.014702:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869701.014752:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869701.014763:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545238272 00000100:00100000:3.0:1788869701.014796:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545238272 00000100:00100000:0.0:1788869701.014857:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545238400 00000100:00100000:0.0:1788869701.014863:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545238400 00000100:00100000:3.0:1788869701.014876:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 218 00000100:00100000:3.0:1788869701.014888:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+47:12429:x1875765545238272:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869701.014922:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869701.015003:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3aba lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaad25 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869701.015009:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:0.0:1788869701.015017:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84043800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+47:2388:x1875765545238400:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869701.015037:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869701.015067:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3aac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad1e expref: 48 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.015087:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99fe821d6800) 00010000:00010000:0.0:1788869701.015092:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869701.015140:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3ac1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.015156:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3ac1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869701.015177:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84043800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+47:2388:x1875765545238400:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 161us (423us total) trans 0 rc 0/0 00010000:00010000:3.0:1788869701.015181:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3ac1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869701.015185:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00000004:00200000:3.0:1788869701.015195:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788869701.015477:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3aba lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad25 expref: 48 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.015494:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3ac1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad25 expref: 47 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.015502:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99fe821d6800) 00010000:00010000:3.0:1788869701.015551:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788869701.015555:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81535200, rc 0) 00000100:00100000:3.0:1788869701.015596:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+47:12429:x1875765545238272:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 710us (906us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1788869701.015603:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 218 00000100:00100000:1.0:1788869701.017040:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554727040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869701.017282:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869701.017353:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554727168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869701.017382:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554727040 00000100:00100000:3.0:1788869701.017390:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554727040 00000100:00100000:1.0:1788869701.017398:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869701.017437:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788869701.017462:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554727040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869701.017500:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788869701.017516:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554727168 00000100:00100000:2.0:1788869701.017520:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554727168 00000100:00100000:3.0:1788869701.017551:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554727040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869701.017558:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788869701.017568:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788869701.017574:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3616:x1875765554727168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869701.017597:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788869701.017613:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869701.017641:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3616:x1875765554727168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.017646:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788869701.017747:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554727040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869701.017763:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554727168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869701.027850:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869701.027932:0:14581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545238528 00000100:00100000:0.0:1788869701.027950:0:14581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545238528 00000100:00100000:0.0:1788869701.028041:0:14581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:0.0:1788869701.028054:0:14581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf4fff62-1855-4361-a244-1a23eb291d37+8:2387:x1875765545238528:12345-192.168.201.30@tcp:1:lfs.0 00010000:00010000:0.0:1788869701.028121:0:14581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc3acf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.028149:0:14581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7b97b93/0xbead52e175fc3a90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad10 expref: 8 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.028161:0:14581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869701.028167:0:14581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869701.028172:0:14581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc3acf lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.028216:0:14581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a7b97b93/0xbead52e175fc3a90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad10 expref: 8 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.028233:0:14581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a7b97b93/0xbead52e175fc3a90 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad10 expref: 8 pid: 8400 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869701.028283:0:14581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84026d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14581:1875765554727296:192.168.201.30@tcp:104: 00000100:00100000:0.0:1788869701.028395:0:14581:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff88e3ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869701.030352:0:14581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84026d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14581:1875765554727296:192.168.201.30@tcp:104: 00010000:00010000:0.0:1788869701.030388:0:14581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc3acf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869701.031686:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869701.031784:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545238656 00000100:00100000:0.0:1788869701.031822:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545238656 00002000:00100000:0.0:1788869701.031887:0:8404:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff99fe84042d80 x1875765545238656/t0(0) o4->bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp:647/0 lens 504/0 e 0 to 0 dl 1788869712 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788869701.031899:0:8404:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99fe84042d80 with x1875765545238656 ext(0->8) 00010000:00010000:0.0:1788869701.031909:0:8404:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a7b97b93/0xbead52e175fc3a90 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad10 expref: 9 pid: 8400 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.031927:0:8404:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a7b97b93/0xbead52e175fc3a90 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad10 expref: 9 pid: 8400 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788869701.031936:0:8404:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99fe84042d80 00000100:00100000:0.0:1788869701.031977:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:0.0:1788869701.031987:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf4fff62-1855-4361-a244-1a23eb291d37+9:2388:x1875765545238656:12345-192.168.201.30@tcp:4:lfs.0 00000100:00100000:0.0:1788869701.033524:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf4fff62-1855-4361-a244-1a23eb291d37+11:2388:x1875765545238656:12345-192.168.201.30@tcp:4:lfs.0 Request processed in 1527us (1834us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788869701.033539:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00002000:00100000:0.0:1788869701.033553:0:8404:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff99fe84042d80 x1875765545238656/t4294967309(0) o4->bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp:647/0 lens 504/448 e 0 to 0 dl 1788869712 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788869701.033564:0:8404:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99fe84042d80 with x1875765545238656 ext(0->8) 00010000:00010000:0.0:1788869701.033575:0:8404:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a7b97b93/0xbead52e175fc3a90 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad10 expref: 11 pid: 8400 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.033592:0:8404:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a7b97b93/0xbead52e175fc3a90 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad10 expref: 11 pid: 8400 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788869701.033618:0:8404:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99fe84042d80 00000100:00100000:2.0:1788869701.036247:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869701.036361:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545238784 00000100:00100000:3.0:1788869701.036373:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545238784 00010000:00010000:3.0:1788869701.036434:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a7b97b93/0xbead52e175fc3a90 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad10 expref: 11 pid: 8400 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869701.036512:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 98 00000100:00100000:3.0:1788869701.036523:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84041f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+11:2387:x1875765545238784:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869701.036545:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788869701.036569:0:9488:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788869701.036572:0:9488:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788869701 00002000:00010000:3.0:1788869701.036574:0:9488:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788869701 00002000:00010000:3.0:1788869701.036576:0:9488:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788869701 00002000:00010000:3.0:1788869701.036578:0:9488:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788869701.036584:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a7b97b93/0xbead52e175fc3a90 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad10 expref: 11 pid: 8400 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.036599:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a7b97b93/0xbead52e175fc3a90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad10 expref: 11 pid: 8400 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.036651:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7b97b93/0xbead52e175fc3a90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad10 expref: 11 pid: 8400 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.036671:0:9488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788869701.036676:0:9488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788869701.036684:0:9488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc3acf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.036695:0:9488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc3acf lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.036732:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869701.036758:0:14581:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc3acf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.036769:0:14581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc3acf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.036792:0:14581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc3acf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.036801:0:14581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc3acf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.036818:0:14581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc3acf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.036827:0:14581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05400 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869701.036832:0:14581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc3acf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.036842:0:14581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc3acf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.036852:0:14581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc3acf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.036858:0:14581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc3acf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869701.036937:0:14581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf4fff62-1855-4361-a244-1a23eb291d37+10:2387:x1875765545238528:12345-192.168.201.30@tcp:1:lfs.0 Request processed in 8885us (9100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.036943:0:14581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:3.0:1788869701.037579:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84041f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+9:2387:x1875765545238784:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1054us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869701.037589:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 98 00000100:00100000:2.0:1788869701.040092:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869701.040496:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545239040 00000100:00100000:1.0:1788869701.040508:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545239040 00000100:00100000:1.0:1788869701.040589:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:1.0:1788869701.040598:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae5b9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+47:12429:x1875765545239040:12345-192.168.201.30@tcp:35:lfs.0 00000004:00010000:1.0:1788869701.040668:0:6488:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3ac1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad25 expref: 47 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788869701.040882:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1788869701.040903:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1788869701.041237:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:1.0:1788869701.041526:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3ad6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.041545:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3a7b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad02 expref: 51 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.041558:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3ad6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.041599:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3a7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad02 expref: 51 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.041614:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3a7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad02 expref: 51 pid: 9496 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869701.041655:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8399a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6488:1875765554727424:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788869701.041790:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe832afc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869701.044241:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869701.044502:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545239168 00000100:00100000:3.0:1788869701.044515:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545239168 00010000:00010000:3.0:1788869701.044566:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3a7b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad02 expref: 52 pid: 9496 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869701.044615:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 99 00000100:00100000:3.0:1788869701.044628:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84040e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+52:2388:x1875765545239168:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869701.044650:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869701.044659:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3a7b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad02 expref: 52 pid: 9496 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.044697:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3a7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad02 expref: 52 pid: 9496 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.044726:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99fe821d6800) 00010000:00010000:3.0:1788869701.044732:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3ad6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.044742:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3ad6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.044750:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3a7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad02 expref: 52 pid: 9496 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.044751:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3ad6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869701.044769:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8399a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6488:1875765554727424:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869701.044775:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869701.044848:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84040e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+51:2388:x1875765545239168:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 223us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869701.044857:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 99 00010000:00010000:1.0:1788869701.045697:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3ad6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.045713:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3ad6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.045720:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3ad6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788869701.045987:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:1.0:1788869701.046140:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1788869701.046344:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8399a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6488:1875765554727552:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788869701.046532:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869701.046619:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe832afa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869701.046850:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554727552 00000100:00100000:3.0:1788869701.046860:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554727552 00000100:00100000:3.0:1788869701.047021:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788869701.047032:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6488:x1875765554727552:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788869701.047156:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6488:x1875765554727552:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 126us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869701.047164:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788869701.047235:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8399a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6488:1875765554727552:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788869701.047418:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1788869701.047499:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8399a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6488:1875765554727680:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788869701.047534:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869701.048063:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe832af900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869701.048120:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554727680 00000100:00100000:0.0:1788869701.048127:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554727680 00000100:00100000:0.0:1788869701.048166:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788869701.048174:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8399aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6488:x1875765554727680:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788869701.048369:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8399aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6488:x1875765554727680:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 196us (833us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788869701.048376:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788869701.048493:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8399a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6488:1875765554727680:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788869701.048568:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1788869701.048609:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3ad6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.048622:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3ad6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.048632:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3ad6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.048640:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869701.048645:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3ad6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.048655:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3ad6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.048676:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99fe821d6800) 00010000:00010000:1.0:1788869701.048679:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788869701.048685:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3ad6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.048693:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3ad6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788869701.048827:0:6488:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788869701.048907:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788869701.048921:0:6488:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 318975667159ns, next at 319975663949ns, rc = 0 00000001:00080000:1.0:1788869701.048938:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1788869701.048961:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99fe821d6800) 00010000:00010000:1.0:1788869701.048964:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788869701.048979:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3ac1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad25 expref: 55 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869701.049102:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae5b9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+54:12429:x1875765545239040:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 8504us (9019us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788869701.049111:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 56 00000020:00080000:1.0:1788869701.049116:0:6488:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788869701.052931:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869701.053181:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545239296 00000100:00100000:3.0:1788869701.053195:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545239296 00000100:00100000:3.0:1788869701.053318:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 219 00000100:00100000:3.0:1788869701.053331:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+54:12429:x1875765545239296:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869701.053382:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869701.053412:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3add lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaad2c expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.053513:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3add lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad2c expref: 55 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.053533:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3add lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad2c expref: 55 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.053555:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:3.0:1788869701.053559:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788869701.053563:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81535400, rc 0) 00000100:00100000:3.0:1788869701.053638:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+55:12429:x1875765545239296:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 309us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869701.053645:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 219 00000100:00100000:0.0:1788869701.058572:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869701.058691:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545239552 00000100:00100000:3.0:1788869701.058704:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545239552 00000100:00100000:3.0:1788869701.058800:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:3.0:1788869701.058814:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+55:12429:x1875765545239552:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1788869701.059128:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+56:12429:x1875765545239552:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 315us (570us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788869701.059136:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:0.0:1788869701.097358:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869701.097431:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545239680 00000100:00100000:3.0:1788869701.097458:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545239680 00000100:00100000:3.0:1788869701.097539:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 220 00000100:00100000:3.0:1788869701.097552:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+56:12439:x1875765545239680:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:3.0:1788869701.097689:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3ae4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.097711:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3ae4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.097728:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3ae4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.097755:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3aeb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.097762:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3aeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.097769:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3aeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.097867:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3af2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.097877:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3af2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.097883:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3af2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869701.097947:0:12967:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3af2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.097962:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3ae4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.098229:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3ae4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.098331:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3ae4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.098340:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869701.098345:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3ae4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.098353:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3ae4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.098368:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:3.0:1788869701.098371:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869701.098376:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3ae4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.098382:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc3ae4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.098397:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3aeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.098403:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3aeb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.098409:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3aeb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.098414:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9f400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869701.098423:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3aeb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.098429:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3aeb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.098436:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99ff88bbfe00) 00010000:00010000:3.0:1788869701.098439:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869701.098442:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3aeb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.098462:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3aeb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.098472:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3af2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.098477:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3af2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.098483:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3af2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.098486:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9e800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869701.098489:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3af2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.098495:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3af2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.098501:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:3.0:1788869701.098503:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869701.098511:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3af2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.098516:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3af2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869701.098611:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+56:12439:x1875765545239680:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 1060us (1273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869701.098621:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 220 00000100:00100000:2.0:1788869701.125412:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869701.125512:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545239936 00000100:00100000:3.0:1788869701.125526:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545239936 00000100:00100000:3.0:1788869701.125600:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 221 00000100:00100000:3.0:1788869701.125612:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+56:12442:x1875765545239936:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869701.125642:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869701.125671:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3af9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaad33 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.125757:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3b00 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.125774:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3b00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.125788:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3b00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.125800:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.125808:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.125838:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.125975:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3b0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.125984:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3b0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.125992:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3b0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869701.126003:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788869701.126096:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3b00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.126104:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3b00 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.126111:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3b00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.126117:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9f400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869701.126122:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3b00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.126129:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3b00 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.126142:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:3.0:1788869701.126145:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869701.126154:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3b00 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.126162:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3b00 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.126177:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.126184:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b07 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.126190:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.126195:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fe00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869701.126198:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.126203:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.126209:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99ff88bbfe00) 00010000:00010000:3.0:1788869701.126211:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869701.126214:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b07 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.126220:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.126317:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3af9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad33 expref: 59 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.126343:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3b0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad33 expref: 58 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.126352:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:3.0:1788869701.126354:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869701.126356:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9f600, rc 0) 00000100:00100000:3.0:1788869701.126427:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+58:12442:x1875765545239936:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 817us (1028us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788869701.126434:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 221 00000100:00100000:0.0:1788869701.128976:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869701.129099:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545240064 00000100:00100000:2.0:1788869701.129112:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545240064 00000100:00100000:2.0:1788869701.129210:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 222 00000100:00100000:2.0:1788869701.129223:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+58:12442:x1875765545240064:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:2.0:1788869701.129366:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3b1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.129388:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.129402:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.129463:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.129471:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3b1c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.129479:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3b1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.129486:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869701.129491:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3b1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.129500:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3b1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.129514:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:2.0:1788869701.129518:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788869701.129523:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3b1c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.129541:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3b1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869701.129629:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+58:12442:x1875765545240064:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 410us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.129638:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 222 00000100:00100000:1.0:1788869701.137067:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869701.137185:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545240320 00000100:00100000:0.0:1788869701.137199:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545240320 00000100:00100000:0.0:1788869701.137292:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:0.0:1788869701.137304:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+58:12442:x1875765545240320:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1788869701.137794:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+59:12442:x1875765545240320:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 489us (741us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1788869701.137803:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:1.0:1788869701.218576:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869701.218678:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545240576 00000100:00100000:3.0:1788869701.218692:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545240576 00000100:00100000:3.0:1788869701.218770:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 223 00000100:00100000:3.0:1788869701.218783:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+59:12452:x1875765545240576:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1788869701.218822:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869701.218826:0:12967:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788869701.218860:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3a9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad17 expref: 59 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.218881:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:3.0:1788869701.218885:0:12967:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869701.218898:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3b23 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaad3a expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.219056:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b2a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.219078:0:12967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3b0e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad33 expref: 59 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.219085:0:12967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b2a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.219121:0:12967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3b0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad33 expref: 59 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.219133:0:12967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3b0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad33 expref: 59 pid: 9496 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869701.219146:0:12967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12967:1875765554727808:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869701.219489:0:12967:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2480 going to sleep for 11 seconds 00000100:00100000:3.0:1788869701.221091:0:12967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12967:1875765554727808:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788869701.221094:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1788869701.221130:0:12967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b2a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869701.221234:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545240704 00000100:00100000:0.0:1788869701.221331:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545240704 00010000:00010000:0.0:1788869701.221379:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3b0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad33 expref: 60 pid: 9496 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869701.221423:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 100 00000100:00100000:0.0:1788869701.221434:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84042a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+60:2389:x1875765545240704:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869701.221525:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869701.221532:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3b0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad33 expref: 60 pid: 9496 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.221545:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3b0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad33 expref: 60 pid: 9496 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.221570:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3b0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad33 expref: 60 pid: 9496 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.221618:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:0.0:1788869701.221624:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b2a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.221634:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.221643:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b2a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.221676:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869701.221711:0:12967:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.221722:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869701.221740:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84042a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+59:2389:x1875765545240704:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 307us (657us total) trans 0 rc 0/0 00000004:00200000:3.0:1788869701.221746:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00000100:00100000:0.0:1788869701.221752:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 100 00010000:00010000:3.0:1788869701.221916:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3b23 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad3a expref: 60 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.221966:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b2a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad3a expref: 59 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.221976:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:3.0:1788869701.221979:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788869701.221982:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9fe00, rc 0) 00000100:00100000:3.0:1788869701.222013:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+59:12452:x1875765545240576:12345-192.168.201.30@tcp:101:bash.0 Request processed in 3233us (3455us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788869701.222022:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 223 00000100:00100000:1.0:1788869701.226925:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869701.227183:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545240832 00000100:00100000:2.0:1788869701.227202:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545240832 00000100:00100000:2.0:1788869701.227562:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 224 00000100:00100000:2.0:1788869701.227579:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+59:12452:x1875765545240832:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1788869701.227617:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869701.227648:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc3b38 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaad41 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.227698:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3b3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.227718:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3b3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.227733:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3b3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.227892:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc3b38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad41 expref: 61 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.227918:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3b3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad41 expref: 60 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.228044:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:2.0:1788869701.228049:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788869701.228054:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0200, rc 0) 00000100:00100000:2.0:1788869701.228213:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+60:12452:x1875765545240832:12345-192.168.201.30@tcp:101:bash.0 Request processed in 638us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.228222:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 224 00000100:00100000:1.0:1788869701.231635:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869701.231700:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545241088 00000100:00100000:0.0:1788869701.231715:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545241088 00000100:00100000:0.0:1788869701.231779:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 225 00000100:00100000:0.0:1788869701.231788:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8399b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+60:12452:x1875765545241088:12345-192.168.201.30@tcp:36:bash.0 00010000:00010000:0.0:1788869701.232066:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3b46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.232085:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3b46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.232096:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3b46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869701.232134:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1788869701.232151:0:6485:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000565280cf reply state 00000000e5772fa8 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3b46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.232161:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3b46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.232169:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:0.0:1788869701.232172:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869701.232176:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869701.232301:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8399b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+63:12452:x1875765545241088:12345-192.168.201.30@tcp:36:bash.0 Request processed in 514us (681us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788869701.232306:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 225 00000020:00080000:0.0:1788869701.232311:0:6485:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788869701.234795:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869701.234861:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545241216 00000100:00100000:3.0:1788869701.234875:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545241216 00000100:00100000:3.0:1788869701.235143:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 226 00000100:00100000:3.0:1788869701.235157:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+63:12452:x1875765545241216:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1788869701.235190:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869701.235216:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3b4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaad48 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.235366:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3b54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.235401:0:12967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b2a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad3a expref: 64 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.235413:0:12967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3b54 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.235471:0:12967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b2a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad3a expref: 64 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.235505:0:12967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b2a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad3a expref: 64 pid: 12967 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869701.235525:0:12967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12967:1875765554727936:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869701.235700:0:12967:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2480 going to sleep for 11 seconds 00000100:00100000:1.0:1788869701.237853:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869701.237964:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545241344 00000100:00100000:2.0:1788869701.237977:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545241344 00010000:00010000:2.0:1788869701.238025:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b2a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad3a expref: 65 pid: 12967 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869701.238080:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 101 00000100:00100000:2.0:1788869701.238092:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83999500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+65:2387:x1875765545241344:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869701.238113:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869701.238120:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b2a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad3a expref: 65 pid: 12967 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.238136:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b2a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad3a expref: 65 pid: 12967 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.238166:0:9488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:2.0:1788869701.238173:0:9488:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3b54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.238185:0:9488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3b54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.238219:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3b54 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.238293:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869701.238361:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83999500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+65:2387:x1875765545241344:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 271us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.238371:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 101 00010000:00010000:3.0:1788869701.238830:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b2a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad3a expref: 64 pid: 12967 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869701.238853:0:12967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12967:1875765554727936:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869701.238878:0:12967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3b54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.238890:0:12967:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3b54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.238896:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3b54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869701.239026:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788869701.239032:0:12967:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869701.239059:0:12967:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3b54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.239095:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3b4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad48 expref: 64 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.239114:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3b54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad48 expref: 63 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.239137:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:3.0:1788869701.239140:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869701.239143:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9ee00, rc 0) 00000100:00100000:3.0:1788869701.239290:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+63:12452:x1875765545241216:12345-192.168.201.30@tcp:101:bash.0 Request processed in 4091us (4465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869701.239301:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 226 00000100:00100000:1.0:1788869701.241055:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869701.241149:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545241600 00000100:00100000:3.0:1788869701.241161:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545241600 00000100:00100000:3.0:1788869701.241229:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:3.0:1788869701.241242:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+63:12452:x1875765545241600:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:3.0:1788869701.241703:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+64:12452:x1875765545241600:12345-192.168.201.30@tcp:35:bash.0 Request processed in 463us (658us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1788869701.241712:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:1.0:1788869701.273500:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869701.273595:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545241728 00000100:00100000:2.0:1788869701.273610:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545241728 00000100:00100000:2.0:1788869701.273690:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 227 00000100:00100000:2.0:1788869701.273703:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff87c6d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+64:12458:x1875765545241728:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1788869701.273737:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869701.273767:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc3b5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaad4f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.273856:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3b62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.273873:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3b62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.273887:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3b62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869701.273956:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788869701.273960:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869701.273982:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3b62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.274033:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0800/0xbead52e175fc3b5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad4f expref: 66 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.274055:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3b62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad4f expref: 65 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.274065:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:2.0:1788869701.274069:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869701.274073:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0400, rc 0) 00000100:00100000:2.0:1788869701.274149:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff87c6d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+65:12458:x1875765545241728:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 448us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.274157:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 227 00000100:00100000:0.0:1788869701.278480:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869701.278532:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545241856 00000100:00100000:2.0:1788869701.278547:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545241856 00000100:00100000:2.0:1788869701.278619:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 228 00000100:00100000:2.0:1788869701.278630:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+65:12458:x1875765545241856:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1788869701.278657:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869701.278684:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3b69 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaad56 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.278764:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3b70 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.278782:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3b70 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.278793:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3b70 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.278824:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3b77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.278833:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3b77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.278840:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3b77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.278944:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3b7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.278955:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3b7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.278960:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3b7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869701.279005:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788869701.279010:0:9496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869701.279032:0:9496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3b7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.279047:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3b7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.279056:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3b70 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.279062:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3b70 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.279080:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3b70 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.279087:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1e00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869701.279092:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3b70 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.279100:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3b70 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.279114:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:2.0:1788869701.279117:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869701.279122:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3b70 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.279129:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3b70 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.279144:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3b77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.279151:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3b77 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.279157:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3b77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.279162:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869701.279165:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3b77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.279181:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3b77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.279189:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99ff88bbfe00) 00010000:00010000:2.0:1788869701.279192:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869701.279195:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3b77 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.279201:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc3b77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.279229:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3b69 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad56 expref: 67 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.279246:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3b7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad56 expref: 66 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.279307:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:2.0:1788869701.279309:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869701.279312:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1800, rc 0) 00000100:00100000:2.0:1788869701.279396:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+66:12458:x1875765545241856:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 767us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.279404:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 228 00000100:00100000:1.0:1788869701.285995:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869701.286211:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545241984 00000100:00100000:3.0:1788869701.286226:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545241984 00000100:00100000:3.0:1788869701.286395:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:3.0:1788869701.286409:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89daac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+66:2390:x1875765545241984:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869701.286455:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869701.286490:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3b7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad56 expref: 66 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.286509:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:3.0:1788869701.286514:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869701.286583:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89daac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+65:2390:x1875765545241984:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 178us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869701.286608:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:1.0:1788869701.288513:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869701.288636:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545242240 00000100:00100000:3.0:1788869701.288648:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545242240 00000100:00100000:3.0:1788869701.288716:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 229 00000100:00100000:3.0:1788869701.288729:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+65:12458:x1875765545242240:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869701.288755:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869701.288781:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3b85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaad5d expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.288916:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b8c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.288944:0:12967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3b54 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad48 expref: 66 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.288955:0:12967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b8c lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.288998:0:12967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3b54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad48 expref: 66 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.289011:0:12967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3b54 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad48 expref: 66 pid: 12967 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869701.289028:0:12967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12967:1875765554728064:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869701.289131:0:12967:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2900 going to sleep for 11 seconds 00000100:00100000:3.0:1788869701.291329:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869701.291493:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545242368 00000100:00100000:2.0:1788869701.291504:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545242368 00010000:00010000:2.0:1788869701.291550:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3b54 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad48 expref: 67 pid: 12967 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869701.291614:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 102 00000100:00100000:2.0:1788869701.291626:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+67:2388:x1875765545242368:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869701.291645:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869701.291653:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3b54 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad48 expref: 67 pid: 12967 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.291669:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3b54 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad48 expref: 67 pid: 12967 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.291697:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:2.0:1788869701.291704:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b8c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.291716:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b8c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.291724:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b8c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.291746:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869701.291805:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+67:2388:x1875765545242368:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 181us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.291813:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 102 00010000:00010000:1.0:1788869701.292155:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3b54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad48 expref: 66 pid: 12967 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869701.292176:0:12967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12967:1875765554728064:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788869701.292200:0:12967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b8c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.292211:0:12967:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b8c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.292216:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b8c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869701.292286:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788869701.292469:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3b85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad5d expref: 67 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.292487:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b8c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad5d expref: 66 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.292495:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:1.0:1788869701.292498:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788869701.292501:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9fe00, rc 0) 00000100:00100000:1.0:1788869701.292548:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+66:12458:x1875765545242240:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 3823us (4048us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788869701.292556:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 229 00000100:00100000:3.0:1788869701.294713:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869701.294908:0:9487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545242624 00000100:00100000:1.0:1788869701.294919:0:9487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545242624 00000100:00100000:1.0:1788869701.295005:0:9487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:1.0:1788869701.295016:0:9487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4fff62-1855-4361-a244-1a23eb291d37+66:12458:x1875765545242624:12345-192.168.201.30@tcp:103:lfs.0 00010000:00010000:1.0:1788869701.295034:0:9487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869701.295064:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc3add lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad2c expref: 66 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.295088:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:1.0:1788869701.295094:0:9487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869701.295353:0:9487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4fff62-1855-4361-a244-1a23eb291d37+65:12458:x1875765545242624:12345-192.168.201.30@tcp:103:lfs.0 Request processed in 338us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869701.295361:0:9487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:2.0:1788869701.297517:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869701.297593:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545242752 00000100:00100000:3.0:1788869701.297604:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545242752 00000100:00100000:3.0:1788869701.297664:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 230 00000100:00100000:3.0:1788869701.297674:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+65:12458:x1875765545242752:12345-192.168.201.30@tcp:58:lfs.0 00010000:00010000:3.0:1788869701.297806:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3b9a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.297828:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3b9a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869701.297842:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3b9a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788869701.297967:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788869701.298092:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+65:12458:x1875765545242752:12345-192.168.201.30@tcp:58:lfs.0 Request processed in 420us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869701.298098:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 230 00000100:00100000:3.0:1788869701.299768:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869701.299829:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545242880 00000100:00100000:2.0:1788869701.299839:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545242880 00000100:00100000:2.0:1788869701.299902:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 231 00000100:00100000:2.0:1788869701.299931:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+65:12458:x1875765545242880:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1788869701.299954:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869701.299977:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3ba1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaad64 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.300042:0:9496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3b9a lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.300052:0:9496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3ba1 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad64 expref: 66 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.300070:0:9496:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3b9a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.300081:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3ba1 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad64 expref: 66 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.300093:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:2.0:1788869701.300096:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788869701.300098:0:9496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3ba1 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad64 expref: 66 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.300103:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1e00, rc 0) 00000100:00100000:2.0:1788869701.300167:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+66:12458:x1875765545242880:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 232us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.300171:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 231 00000100:00100000:3.0:1788869701.528744:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554728192:0@lo:400:kworker.0 00000100:00100000:3.0:1788869701.528836:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869701.528910:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554728192 00000100:00100000:0.0:1788869701.528918:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554728192 00000100:00100000:2.0:1788869701.528986:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554728320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869701.529020:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869701.529060:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869701.529064:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554728448:0@lo:400:kworker.0 00000100:00100000:2.0:1788869701.529085:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869701.529108:0:13961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554728320 00000100:00100000:2.0:1788869701.529110:0:13961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554728320 00000100:00100000:2.0:1788869701.529155:0:13961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788869701.529162:0:13961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554728320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788869701.529186:0:13961:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869701.529228:0:13961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554728320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.529233:0:13961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:2.0:1788869701.529268:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869701.529297:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554728320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869701.529338:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554728576:0@lo:400:kworker.0 00000100:00100000:2.0:1788869701.529367:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869701.529402:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554728576 00000100:00100000:2.0:1788869701.529405:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554728576 00000100:00100000:2.0:1788869701.529423:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788869701.529427:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554728576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869701.529474:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554728576:12345-0@lo:400:kworker.0 Request processed in 46us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.529479:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788869701.529537:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1788869701.529559:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554728576:0@lo:400:kworker.0 00000100:00100000:3.0:1788869701.529603:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554728448 00000100:00100000:0.0:1788869701.529603:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554728192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869701.529609:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554728448 00000100:00100000:3.0:1788869701.529652:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788869701.529659:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554728448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869701.529760:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554728960:0@lo:400:kworker.0 00000100:00100000:1.0:1788869701.529815:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554728704:0@lo:400:kworker.0 00000100:00100000:3.0:1788869701.529863:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554729088:0@lo:400:kworker.0 00000100:00100000:0.0:1788869701.529883:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3617:x1875765554728192:12345-0@lo:400:kworker.0 Request processed in 338us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869701.529897:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1788869701.529910:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869701.529933:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554729600:0@lo:400:kworker.0 00000100:00100000:0.0:1788869701.529942:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554729088 00000100:00100000:0.0:1788869701.529946:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554729088 00000100:00100000:3.0:1788869701.529958:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869701.529993:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869701.530278:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875765554729472:0@lo:400:kworker.0 00000100:00100000:2.0:1788869701.530299:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869701.530623:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554729600 00000100:00100000:1.0:1788869701.530624:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554728960 00000100:00100000:0.0:1788869701.530627:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554729600 00000100:00100000:1.0:1788869701.530631:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554728960 00000100:00100000:1.0:1788869701.530661:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788869701.530685:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788869701.530692:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554728960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869701.530731:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554728960:12345-0@lo:400:kworker.0 Request processed in 41us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869701.530737:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788869701.530753:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788869701.530778:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554729088:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788869701.530780:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869701.530785:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869701.530797:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554728832:0@lo:400:kworker.0 00000100:00100000:1.0:1788869701.530816:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554729088:12345-0@lo:400:kworker.0 Request processed in 148us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869701.530821:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788869701.530828:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869701.530847:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554729344:0@lo:400:kworker.0 00000100:00100000:0.0:1788869701.530864:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869701.530935:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554728960:0@lo:400:kworker.0 00000100:00100000:2.0:1788869701.530959:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554728832 00000100:00100000:2.0:1788869701.530961:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554728832 00000100:00100000:2.0:1788869701.530980:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788869701.530984:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554728832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869701.531010:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554728832:12345-0@lo:400:kworker.0 Request processed in 26us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.531014:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788869701.531028:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554728832:0@lo:400:kworker.0 00000100:00100000:2.0:1788869701.531059:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554728448:12345-0@lo:400:kworker.0 Request processed in 1401us (1973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.531064:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788869701.531082:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554728448:0@lo:400:kworker.0 00000100:00100000:2.0:1788869701.531091:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554729472 00000100:00100000:2.0:1788869701.531093:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554729472 00000100:00080000:2.0:1788869701.531103:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869701.531113:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788869701.531117:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875765554729472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869701.531137:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875765554729472:12345-0@lo:400:kworker.0 Request processed in 20us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.531141:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788869701.531153:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875765554729472:0@lo:400:kworker.0 00010000:00080000:2.0:1788869701.531180:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfa49180 x1875765554729088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869701.531188:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554729088:0@lo:400:kworker.0 00000100:00100000:0.0:1788869701.531273:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869701.531288:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554729216:0@lo:400:kworker.0 00000100:00100000:0.0:1788869701.531305:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869701.531320:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554729728:0@lo:400:kworker.0 00000100:00100000:0.0:1788869701.531341:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869701.531365:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554728192:0@lo:400:kworker.0 00000100:00100000:0.0:1788869701.531386:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554729344 00000100:00100000:0.0:1788869701.531389:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554729344 00000100:00100000:0.0:1788869701.531412:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554729216 00000100:00100000:0.0:1788869701.531413:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554729216 00000100:00100000:0.0:1788869701.531425:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554729728 00000100:00100000:0.0:1788869701.531427:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554729728 00000100:00100000:0.0:1788869701.531436:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788869701.531439:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3618:x1875765554729344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869701.531491:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3618:x1875765554729344:12345-0@lo:400:kworker.0 Request processed in 49us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.531501:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554728704 00000100:00100000:2.0:1788869701.531504:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554728704 00000100:00100000:0.0:1788869701.531506:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788869701.531517:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788869701.531523:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554729216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869701.531525:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788869701.531529:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554728704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869701.531676:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554728704:12345-0@lo:400:kworker.0 Request processed in 146us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.531683:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788869701.531714:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788869701.531722:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3617:x1875765554729728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869701.531756:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3617:x1875765554729728:12345-0@lo:400:kworker.0 Request processed in 35us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.531763:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788869701.531763:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554729216:12345-0@lo:400:kworker.0 Request processed in 240us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869701.531769:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1788869701.531781:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869701.531799:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554729344:0@lo:400:kworker.0 00000100:00100000:0.0:1788869701.531806:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554728704:0@lo:400:kworker.0 00000100:00100000:0.0:1788869701.531816:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554729216:0@lo:400:kworker.0 00000100:00100000:0.0:1788869701.531825:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554729728:0@lo:400:kworker.0 00000100:00100000:3.0:1788869701.531899:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554729600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869701.531934:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554729600:12345-0@lo:400:kworker.0 Request processed in 1176us (1977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869701.531941:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00010000:00080000:2.0:1788869701.531968:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfa49c00 x1875765554729600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869701.531980:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554729600:0@lo:400:kworker.0 00010000:00010000:3.0:1788869701.656485:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788869701.848744:0:13761:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788869701.848758:0:13761:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788869701.850128:0:13761:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788869701.850146:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788869701.851012:0:13761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa49c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1875765554729856:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788869701.851621:0:13761:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe832afd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869701.854757:0:13761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa49c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1875765554729856:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788869701.854835:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869701.855487:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545243008 00000100:00100000:2.0:1788869701.855497:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545243008 00000100:00100000:2.0:1788869701.855693:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 232 00000100:00100000:2.0:1788869701.855706:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+66:12459:x1875765545243008:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788869701.855760:0:6484:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788869701.855907:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+66:12459:x1875765545243008:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 204us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.855916:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 232 00000100:00100000:3.0:1788869701.862810:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869701.862884:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545243136 00000100:00100000:0.0:1788869701.862898:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545243136 00000100:00100000:0.0:1788869701.862987:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 233 00000100:00100000:0.0:1788869701.863001:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+66:12459:x1875765545243136:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788869701.863112:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3ba8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.863134:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.863148:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.863167:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3baf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.863174:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3baf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.863201:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3baf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.863231:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3bb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.863240:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.863246:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869701.863555:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788869701.863560:0:6486:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869701.863587:0:6486:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.863600:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.863606:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3ba8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.863612:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3ba8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.863619:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869701.863623:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3ba8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.863631:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3ba8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.863653:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffb89e0700) 00010000:00010000:0.0:1788869701.863656:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869701.863661:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3ba8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.863667:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3ba8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.863684:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3baf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.863690:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3baf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.863696:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3baf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.863701:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869701.863704:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3baf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.863711:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3baf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.864128:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff99fe821d6a00) 00010000:00010000:0.0:1788869701.864132:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869701.864136:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3baf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.864143:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3baf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.864175:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.864183:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3bb6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.864190:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.864195:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04e00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869701.864198:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.864205:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.864213:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:0.0:1788869701.864216:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869701.864219:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3bb6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.864226:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3bb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869701.864629:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+66:12459:x1875765545243136:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 Request processed in 1626us (1826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869701.864641:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 233 00000100:00100000:3.0:1788869701.875355:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869701.875611:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545243392 00000100:00100000:1.0:1788869701.875626:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545243392 00000100:00100000:1.0:1788869701.875713:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 234 00000100:00100000:1.0:1788869701.875728:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+66:12459:x1875765545243392:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869701.875756:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869701.875787:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3bbd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaad6b expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.875933:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3bc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.875954:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.875989:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869701.876005:0:9496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788869701.876113:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.876122:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3bc4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.877545:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.877562:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80030c00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869701.877567:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.877577:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3bc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.877599:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:1.0:1788869701.877602:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788869701.877608:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3bc4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.877616:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3bc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.877714:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3bbd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad6b expref: 68 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.877751:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffb89e0700) 00010000:00010000:1.0:1788869701.877753:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869701.877758:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3bbd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad6b expref: 68 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.877770:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80031000, rc 0) 00000100:00100000:1.0:1788869701.877870:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+67:12459:x1875765545243392:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 2145us (2530us total) trans 4294967505 rc 301/301 00000100:00100000:1.0:1788869701.877880:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 234 00000100:00100000:2.0:1788869701.882750:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869701.884017:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545243520 00000100:00100000:3.0:1788869701.884033:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545243520 00000100:00100000:3.0:1788869701.884128:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 235 00000100:00100000:3.0:1788869701.884138:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+67:12459:x1875765545243520:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788869701.884180:0:6484:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788869701.884340:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+67:12459:x1875765545243520:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 201us (1617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869701.884349:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 235 00000100:00100000:3.0:1788869701.888597:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869701.888680:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545243776 00000100:00100000:0.0:1788869701.888693:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545243776 00000100:00100000:0.0:1788869701.888783:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 236 00000100:00100000:0.0:1788869701.888814:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+67:12459:x1875765545243776:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869701.888842:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869701.888846:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788869701.888881:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3b62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad4f expref: 67 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.888905:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:0.0:1788869701.888911:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869701.888929:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3bd2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaad72 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788869701.889467:0:6486:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:0.0:1788869701.889649:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3bd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.889667:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.889678:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.889748:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3bd2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad72 expref: 69 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.889766:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad72 expref: 68 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.889774:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99fe821d6a00) 00010000:00010000:0.0:1788869701.889777:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869701.889789:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04a00, rc 0) 00000100:00100000:0.0:1788869701.889866:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+68:12459:x1875765545243776:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 1055us (1283us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788869701.889876:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 236 00000100:00100000:2.0:1788869701.896826:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869701.896889:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545244032 00000100:00100000:1.0:1788869701.896901:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545244032 00000100:00100000:1.0:1788869701.896961:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 237 00000100:00100000:1.0:1788869701.896969:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+68:12459:x1875765545244032:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788869701.897041:0:9496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869701.897087:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04a00/0xbead52e175fc3bd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad72 expref: 68 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.897107:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99fe821d6a00) 00010000:00010000:1.0:1788869701.897119:0:9496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869701.897143:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3be7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.897158:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3be7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.897167:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3be7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.900984:0:9496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3bee lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xb7beab13 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.901009:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3bee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xb7beab13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.901024:0:9496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3bee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xb7beab13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.901088:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3be7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.901096:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3be7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.901103:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3be7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.901109:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869701.901113:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3be7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.901121:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3be7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.901136:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:1.0:1788869701.901139:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869701.901143:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3be7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.901149:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc3be7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.901180:0:9496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3bee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xb7beab13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.901186:0:9496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3bee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb7beab13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.901193:0:9496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3bee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb7beab13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.901198:0:9496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80030c00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869701.901201:0:9496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3bee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb7beab13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.901207:0:9496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3bee lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb7beab13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.901214:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xb7beab13 (ffff99fe831e6600) 00010000:00010000:1.0:1788869701.901217:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869701.901220:0:9496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3bee lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xb7beab13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.901225:0:9496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030c00/0xbead52e175fc3bee lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xb7beab13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869701.901356:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+67:12459:x1875765545244032:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 4382us (4541us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788869701.901366:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 237 00000100:00100000:3.0:1788869701.908561:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869701.908614:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545244160 00000100:00100000:2.0:1788869701.908626:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545244160 00000100:00100000:2.0:1788869701.908712:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 238 00000100:00100000:2.0:1788869701.908725:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+67:12459:x1875765545244160:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869701.908758:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869701.908912:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3bf5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaad79 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.908964:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3bfc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.908981:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3bfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.908995:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3bfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.909131:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3bf5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad79 expref: 69 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.909153:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3bfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad79 expref: 68 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.909162:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99ff98fad100) 00010000:00010000:2.0:1788869701.909166:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788869701.909170:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0400, rc 0) 00000100:00100000:2.0:1788869701.909337:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+68:12459:x1875765545244160:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 525us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.909352:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 238 00000100:00100000:3.0:1788869701.913418:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869701.913492:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545244416 00000100:00100000:2.0:1788869701.913506:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545244416 00000100:00100000:2.0:1788869701.913628:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 239 00000100:00100000:2.0:1788869701.913641:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+68:12459:x1875765545244416:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788869701.913749:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc3c03 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.913770:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc3c03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.913783:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc3c03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869701.914015:0:12967:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1788869701.914027:0:12967:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 319840773446ns, next at 320840769871ns, rc = 0 00000004:00010000:2.0:1788869701.914092:0:12967:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000076686576 reply state 000000004dd6ff5b transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc3c03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.914108:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc3c03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.914117:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99ff98fad100) 00010000:00010000:2.0:1788869701.914120:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788869701.914125:0:12967:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869701.914292:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+70:12459:x1875765545244416:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 653us (885us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788869701.914301:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 239 00000100:00100000:2.0:1788869701.917504:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869701.917598:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545244544 00000100:00100000:1.0:1788869701.917613:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545244544 00000100:00100000:1.0:1788869701.917694:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 240 00000100:00100000:1.0:1788869701.917726:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+70:12459:x1875765545244544:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869701.917755:0:9496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869701.917799:0:9496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3c0a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaad80 expref: -99 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.917868:0:9496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3c0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad80 expref: 71 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.917883:0:9496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3c0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad80 expref: 71 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.917902:0:9496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99ff98fad100) 00010000:00010000:1.0:1788869701.917905:0:9496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869701.917909:0:9496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80030000, rc 0) 00000100:00100000:1.0:1788869701.917979:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+71:12459:x1875765545244544:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 259us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869701.917986:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 240 00000100:00100000:3.0:1788869701.920602:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869701.920720:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545244672 00000100:00100000:2.0:1788869701.920733:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545244672 00000100:00100000:2.0:1788869701.920935:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00100000:2.0:1788869701.920948:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+9:2387:x1875765545244672:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788869701.921368:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+10:2387:x1875765545244672:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 422us (776us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788869701.921378:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00100000:2.0:1788869701.924387:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869701.924555:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545244928 00000100:00100000:0.0:1788869701.924568:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545244928 00000100:00100000:0.0:1788869701.924681:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:0.0:1788869701.924695:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+71:12459:x1875765545244928:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788869701.925113:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+72:12459:x1875765545244928:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 421us (865us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1788869701.925122:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:1.0:1788869701.929137:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869701.929277:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545245184 00000100:00100000:2.0:1788869701.929286:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545245184 00000100:00100000:2.0:1788869701.929350:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 241 00000100:00100000:2.0:1788869701.929360:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+72:12459:x1875765545245184:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788869701.929494:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+72:12459:x1875765545245184:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 134us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.929503:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 241 00000100:00100000:2.0:1788869701.932848:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869701.932977:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545245312 00000100:00100000:0.0:1788869701.932987:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545245312 00000100:00100000:0.0:1788869701.935340:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 242 00000100:00100000:0.0:1788869701.935363:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+72:12459:x1875765545245312:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869701.935386:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869701.935409:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3c11 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaad87 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.935501:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3c18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.935516:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3c18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.935528:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3c18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869701.935592:0:12967:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869701.935613:0:12967:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3c18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.935642:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04e00/0xbead52e175fc3c11 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad87 expref: 74 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.935662:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3c18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad87 expref: 73 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869701.935670:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99ff98fad100) 00010000:00010000:0.0:1788869701.935673:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788869701.935676:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04000, rc 0) 00000100:00100000:0.0:1788869701.936740:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+73:12459:x1875765545245312:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 1382us (3896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869701.936750:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 242 00000100:00100000:3.0:1788869701.942994:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869701.943129:0:14581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545245440 00000100:00100000:2.0:1788869701.943143:0:14581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545245440 00000100:00100000:2.0:1788869701.943217:0:14581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:2.0:1788869701.943229:0:14581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf4fff62-1855-4361-a244-1a23eb291d37+10:2388:x1875765545245440:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869701.943290:0:14581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869701.943319:0:14581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000302964ca/0xbead52e175fc3c1f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaad8e expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788869701.943359:0:14581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ffc46, blocks: 0x0 00010000:00010000:2.0:1788869701.943387:0:14581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=319s v=(0 0) 00010000:00010000:2.0:1788869701.943409:0:14581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869701.943422:0:14581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000302964ca/0xbead52e175fc3c1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad8e expref: 11 pid: 14581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.943459:0:14581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000302964ca/0xbead52e175fc3c1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad8e expref: 11 pid: 14581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869701.943480:0:14581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1a00, rc 0) 00000100:00100000:2.0:1788869701.943603:0:14581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf4fff62-1855-4361-a244-1a23eb291d37+11:2388:x1875765545245440:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 376us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.943612:0:14581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:1.0:1788869701.949737:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869701.949876:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545245696 00000100:00100000:2.0:1788869701.949887:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545245696 00000100:00100000:2.0:1788869701.949959:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 243 00000100:00100000:2.0:1788869701.949970:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+73:12459:x1875765545245696:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788869701.950098:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+73:12459:x1875765545245696:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 129us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869701.950106:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 243 00000100:00100000:3.0:1788869701.956765:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869701.956934:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545245824 00000100:00100000:1.0:1788869701.956945:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545245824 00000100:00100000:1.0:1788869701.957010:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00100000:1.0:1788869701.957020:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+11:12459:x1875765545245824:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869701.957041:0:8399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869701.957060:0:8399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efe8350f/0xbead52e175fc3c26 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaad95 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.957114:0:8399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000302964ca/0xbead52e175fc3c1f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad8e expref: 12 pid: 14581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.957124:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869701.957128:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869701.957135:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efe8350f/0xbead52e175fc3c26 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad95 expref: 12 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.957171:0:8399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000302964ca/0xbead52e175fc3c1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad8e expref: 12 pid: 14581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.957187:0:8399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000302964ca/0xbead52e175fc3c1f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad8e expref: 12 pid: 14581 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869701.957203:0:8399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa4b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8399:1875765554729984:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788869701.957339:0:8399:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe832afd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869701.960072:0:8399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa4b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8399:1875765554729984:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788869701.960111:0:8399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000efe8350f/0xbead52e175fc3c26 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad95 expref: 12 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.960134:0:8399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80031000, rc 0) 00000100:00100000:1.0:1788869701.960198:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+12:12459:x1875765545245824:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 3178us (3443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869701.960207:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00100000:3.0:1788869701.963750:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869701.964524:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545245952 00000100:00100000:1.0:1788869701.964535:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545245952 00010000:00010000:1.0:1788869701.964582:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000302964ca/0xbead52e175fc3c1f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad8e expref: 12 pid: 14581 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869701.964632:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 103 00000100:00100000:1.0:1788869701.964642:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84018380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+12:2388:x1875765545245952:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869701.964658:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869701.964680:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000302964ca/0xbead52e175fc3c1f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad8e expref: 12 pid: 14581 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.964695:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000302964ca/0xbead52e175fc3c1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad8e expref: 12 pid: 14581 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.964719:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000302964ca/0xbead52e175fc3c1f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad8e expref: 12 pid: 14581 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.964737:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869701.964741:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869701.964750:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000efe8350f/0xbead52e175fc3c26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad95 expref: 11 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.964760:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efe8350f/0xbead52e175fc3c26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad95 expref: 11 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869701.964799:0:6470:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000efe8350f/0xbead52e175fc3c26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad95 expref: 11 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869701.964829:0:6470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa4b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6470:1875765554730112:192.168.201.30@tcp:105: 00000100:00100000:1.0:1788869701.964921:0:6470:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe832afd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869701.975876:0:6470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa4b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6470:1875765554730112:192.168.201.30@tcp:105: 00010000:00010000:1.0:1788869701.975901:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869701.975967:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84018380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+11:2388:x1875765545245952:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 11325us (12226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869701.975980:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 103 00000100:00100000:1.0:1788869701.982391:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869701.987015:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545246080 00000100:00100000:2.0:1788869701.987029:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545246080 00002000:00100000:2.0:1788869701.987085:0:8406:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff99ffbfa4b800 x1875765545246080/t0(0) o4->bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp:647/0 lens 504/0 e 0 to 0 dl 1788869712 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788869701.987096:0:8406:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffbfa4b800 with x1875765545246080 ext(0->12) 00002000:00010000:2.0:1788869701.987101:0:8406:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffbfa4b800 00000100:00100000:2.0:1788869701.987126:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:2.0:1788869701.987134:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf4fff62-1855-4361-a244-1a23eb291d37+11:2387:x1875765545246080:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788869701.989480:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bf4fff62-1855-4361-a244-1a23eb291d37+13:2387:x1875765545246080:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 Request processed in 2335us (7088us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788869701.989493:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00002000:00100000:2.0:1788869701.989507:0:8406:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff99ffbfa4b800 x1875765545246080/t4294967321(0) o4->bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp:647/0 lens 504/448 e 0 to 0 dl 1788869712 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788869701.989518:0:8406:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99ffbfa4b800 with x1875765545246080 ext(0->12) 00002000:00010000:2.0:1788869701.989524:0:8406:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ffbfa4b800 00000100:00100000:3.0:1788869701.996301:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869701.996744:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545246208 00000100:00100000:0.0:1788869701.996755:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545246208 00000100:00100000:0.0:1788869701.996820:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 244 00000100:00100000:0.0:1788869701.996830:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+73:12459:x1875765545246208:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788869702.001981:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1788869702.002005:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:3.0:1788869702.002062:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788869702.002095:0:6463:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99fe832afa80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788869702.002102:0:6463:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99ffb9a9a200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99fe832af0c0 00000020:00080000:3.0:1788869702.002106:0:6463:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99ffb9a9a000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fe84206400 00000004:00080000:3.0:1788869702.002136:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1788869702.002168:0:6463:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99fe823203c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788869702.002173:0:6463:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99ffb9a9a600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99fe82320000 00000020:00080000:3.0:1788869702.002178:0:6463:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99ffb9a9a100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fe83b25800 00000020:00080000:3.0:1788869702.002207:0:6463:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1788869702.002243:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:1.0:1788869702.002247:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554730240:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788869702.002369:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788869702.002407:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788869702.002434:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869702.002444:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554730368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788869702.002479:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869702.002524:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554730240 00000100:00100000:1.0:1788869702.002532:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554730240 00000100:00100000:3.0:1788869702.002592:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+27:12459:x1875765545246208:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 Request processed in 5756us (6293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869702.002592:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554730368 00000100:00100000:1.0:1788869702.002599:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554730368 00000100:00100000:3.0:1788869702.002617:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 244 00000100:00100000:1.0:1788869702.002635:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788869702.002650:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3618:x1875765554730240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788869702.002680:0:8527:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:1.0:1788869702.002708:0:8527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc3c2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.002730:0:8527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc39e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaced expref: 12 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.002757:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788869702.002762:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788869702.002767:0:8527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc3c2d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.002796:0:8527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc39e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaced expref: 12 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.002810:0:8527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc39e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaced expref: 12 pid: 14581 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869702.002822:0:8527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8527:1875765554730496:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788869702.002878:0:8527:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe832afd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869702.002899:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788869702.002908:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3618:x1875765554730368:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788869702.003020:0:8401:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788869702.003024:0:8401:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788869702 00002000:00010000:1.0:1788869702.003026:0:8401:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788869702.003028:0:8401:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788869702 -> 1788869702 00002000:00010000:1.0:1788869702.003030:0:8401:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788869702.003083:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3618:x1875765554730368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 177us (603us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788869702.003091:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:3.0:1788869702.003629:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffbfa49880/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788869702.003642:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554730368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788869702.003956:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554730624:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788869702.004011:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788869702.004136:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc392b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.004146:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc392b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.004154:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc392b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.004166:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04c00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869702.004170:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc392b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.004178:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc392b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.004193:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99fe821d6f00) 00010000:00010000:0.0:1788869702.004196:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869702.004200:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc392b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.004206:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04c00/0xbead52e175fc392b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.004229:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc39d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.004235:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc39d3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.004242:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc39d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.004246:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869702.004249:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc39d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.004290:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc39d3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.004307:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99ff98fad600) 00010000:00010000:0.0:1788869702.004309:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869702.004312:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc39d3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.004318:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04800/0xbead52e175fc39d3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.004334:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc3a51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.004340:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc3a51 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.004345:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc3a51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.004350:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534600 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869702.004353:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc3a51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.004359:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc3a51 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.004366:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99ff88bbfe00) 00010000:00010000:0.0:1788869702.004368:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869702.004370:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc3a51 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.004376:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc3a51 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.004417:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3a74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869702.004874:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554730624 00000100:00100000:2.0:1788869702.004881:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554730624 00000100:00100000:2.0:1788869702.004917:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788869702.004925:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3616:x1875765554730624:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788869702.004946:0:8399:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:2.0:1788869702.004974:0:8399:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ffc45, atime: 0x6a9ffc45, ctime: 0x6a9ffc45, blocks: 0x8 00010000:00010000:2.0:1788869702.004980:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e811ee73/0xbead52e175fc3c34 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.004993:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=319s v=(0 0) 00010000:00010000:2.0:1788869702.004997:0:8399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869702.005003:0:8399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e811ee73/0xbead52e175fc3c34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.005017:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e811ee73/0xbead52e175fc3c34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.005025:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e811ee73/0xbead52e175fc3c34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.005039:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e811ee73/0xbead52e175fc3c34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.005064:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869702.005121:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869702.005134:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e811ee73/0xbead52e175fc3c34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.005148:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0800 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869702.005155:0:7425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e811ee73/0xbead52e175fc3c34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.005168:0:7425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e811ee73/0xbead52e175fc3c34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.005192:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e811ee73/0xbead52e175fc3c34 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.005203:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e811ee73/0xbead52e175fc3c34 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869702.005228:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3616:x1875765554730624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 300us (1213us total) trans 4294967311 rc 0/0 00010000:00010000:3.0:1788869702.005233:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869702.005240:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869702.005241:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:3.0:1788869702.005416:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788869702.006430:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fe84043800/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788869702.006441:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554730624:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788869702.006524:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3a74 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.006537:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3a74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.006543:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05c00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869702.006547:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3a74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.006556:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3a74 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.006571:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99ff88bbfe00) 00010000:00010000:0.0:1788869702.006574:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869702.006579:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3a74 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.006585:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3a74 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.006625:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3b46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.006631:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3b46 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.006635:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3b46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.006652:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869702.006655:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3b46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.006660:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3b46 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.006670:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:0.0:1788869702.006672:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869702.006675:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3b46 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.006681:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc3b46 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.006695:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc3c03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.006701:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc3c03 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.006706:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc3c03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.006711:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869702.006713:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc3c03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.006719:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc3c03 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.006741:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99ff98fad100) 00010000:00010000:0.0:1788869702.006744:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788869702.006747:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc3c03 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.006753:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0000/0xbead52e175fc3c03 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869702.010382:0:8527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8527:1875765554730496:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788869702.010416:0:8527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc3c2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869702.010720:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869702.010774:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869702.010838:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545246336 00000100:00100000:1.0:1788869702.010847:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545246336 00000100:00100000:1.0:1788869702.010945:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 77 00000100:00100000:1.0:1788869702.010955:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+13:2388:x1875765545246336:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788869702.011060:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545246464 00000100:00100000:2.0:1788869702.011065:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545246464 00010000:00010000:2.0:1788869702.011090:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc39e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaced expref: 14 pid: 14581 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869702.011121:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 104 00000100:00100000:2.0:1788869702.011129:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+14:2388:x1875765545246464:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869702.011141:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869702.011148:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc39e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaced expref: 14 pid: 14581 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.011161:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc39e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaced expref: 14 pid: 14581 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.011186:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc39e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaced expref: 14 pid: 14581 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.011221:0:9488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869702.011227:0:9488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869702.011233:0:9488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc3c2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.011244:0:9488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc3c2d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.011301:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869702.011352:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+13:2388:x1875765545246464:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 222us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869702.011359:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 104 00010000:00010000:2.0:1788869702.011385:0:8527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc3c2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.011393:0:8527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc3c2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.011403:0:8527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc3c2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.011411:0:8527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc3c2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.011438:0:8527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788869702.011608:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3618:x1875765554730240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8963us (9238us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788869702.011615:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:2.0:1788869702.011772:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869702.011779:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc3c2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.011788:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031200 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869702.011792:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc3c2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.011802:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc3c2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.011814:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc3c2d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.011821:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016328a5e/0xbead52e175fc3c2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.011840:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869702.011842:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869702.011844:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788869702.012688:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ffbfa4b480/2, rc 0, transno 4294967323 00000100:00100000:3.0:1788869702.012703:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554730240:0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1788869702.013035:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788869702.015606:0:9476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1788869702.015622:0:9476:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1788869702.022966:0:8393:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1788869702.022982:0:8393:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1788869702.023296:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+7:2388:x1875765545246336:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 Request processed in 12336us (12515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869702.023307:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 77 00000100:00100000:3.0:1788869702.034193:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869702.034698:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545246720 00000100:00100000:0.0:1788869702.034709:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545246720 00000100:00100000:0.0:1788869702.034802:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 245 00000100:00100000:0.0:1788869702.034813:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+21:12459:x1875765545246720:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788869702.034879:0:12967:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869702.034911:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb04000/0xbead52e175fc3c18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad87 expref: 21 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.034947:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99ff98fad100) 00010000:00010000:0.0:1788869702.034952:0:12967:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869702.034986:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3c3b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.035001:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3c3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.035012:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3c3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869702.035147:0:12967:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001010dfb7 reply state 00000000e5772fa8 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3c3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.035177:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3c3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869702.035184:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99ff98fad100) 00010000:00010000:0.0:1788869702.035188:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869702.035190:0:12967:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869702.035357:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+22:12459:x1875765545246720:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 545us (1174us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1788869702.035364:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 245 00000100:00080000:2.0:1788869702.035759:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869702.038762:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869702.038850:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545246848 00000100:00100000:2.0:1788869702.038859:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545246848 00000100:00100000:2.0:1788869702.038916:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:2.0:1788869702.038935:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+7:2387:x1875765545246848:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788869702.039081:0:8399:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788869702.039085:0:8399:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1788869702 -> 1788869701 00002000:00010000:2.0:1788869702.039087:0:8399:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788869701 00002000:00010000:2.0:1788869702.039089:0:8399:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788869702 -> 1788869701 00002000:00010000:2.0:1788869702.039091:0:8399:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788869702.039146:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+8:2387:x1875765545246848:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 222us (393us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788869702.039153:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:1.0:1788869702.042540:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869702.042786:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545247104 00000100:00100000:3.0:1788869702.042796:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545247104 00000100:00100000:3.0:1788869702.042863:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 246 00000100:00100000:3.0:1788869702.042874:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+22:12459:x1875765545247104:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788869702.042953:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c42 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.042971:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3bfc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad79 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.042980:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c42 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.043016:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3bfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad79 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.043029:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3bfc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad79 expref: 22 pid: 6484 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869702.043042:0:6484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6484:1875765554730752:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869702.043215:0:6484:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2840 going to sleep for 11 seconds 00000100:00100000:3.0:1788869702.047842:0:6484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6484:1875765554730752:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869702.047871:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c42 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869702.048194:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869702.048443:0:9487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545247232 00000100:00100000:2.0:1788869702.048460:0:9487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545247232 00010000:00010000:2.0:1788869702.048501:0:9487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3bfc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad79 expref: 23 pid: 6484 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869702.048544:0:9487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 105 00000100:00100000:2.0:1788869702.048554:0:9487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4fff62-1855-4361-a244-1a23eb291d37+23:2388:x1875765545247232:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869702.048573:0:9487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869702.048580:0:9487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3bfc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad79 expref: 23 pid: 6484 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.048591:0:9487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3bfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad79 expref: 23 pid: 6484 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.048633:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc3bfc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad79 expref: 23 pid: 6484 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.048649:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99ff98fad100) 00010000:00010000:2.0:1788869702.048655:0:9487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c42 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.048666:0:9487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.048675:0:9487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c42 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.048699:0:9487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869702.048761:0:9487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4fff62-1855-4361-a244-1a23eb291d37+22:2388:x1875765545247232:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 207us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869702.048769:0:9487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 105 00010000:00010000:3.0:1788869702.049641:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.049665:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.049707:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.049716:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c42 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.049724:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c42 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.049731:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9e800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869702.049736:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c42 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.049744:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c42 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.049758:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99ff98fad100) 00010000:00010000:3.0:1788869702.049762:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788869702.049766:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c42 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.049774:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c42 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869702.049841:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+21:12459:x1875765545247104:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 Request processed in 6966us (7308us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788869702.049852:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 246 00000100:00100000:1.0:1788869702.054226:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869702.054602:0:14581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545247360 00000100:00100000:2.0:1788869702.054614:0:14581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545247360 00000100:00100000:2.0:1788869702.054706:0:14581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00100000:2.0:1788869702.054716:0:14581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf4fff62-1855-4361-a244-1a23eb291d37+8:2387:x1875765545247360:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788869702.054759:0:14581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e683d0e8/0xbead52e175fc3c49 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.054779:0:14581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000efe8350f/0xbead52e175fc3c26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad95 expref: 8 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.054804:0:14581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869702.054809:0:14581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869702.054814:0:14581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e683d0e8/0xbead52e175fc3c49 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.054848:0:14581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000efe8350f/0xbead52e175fc3c26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad95 expref: 8 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.054861:0:14581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000efe8350f/0xbead52e175fc3c26 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad95 expref: 8 pid: 8399 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869702.054875:0:14581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84041880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14581:1875765554730880:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788869702.054958:0:14581:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae73f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869702.057099:0:14581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84041880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14581:1875765554730880:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788869702.057128:0:14581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e683d0e8/0xbead52e175fc3c49 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869702.059349:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869702.059515:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545247488 00000100:00100000:2.0:1788869702.059525:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545247488 00010000:00010000:2.0:1788869702.059564:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000efe8350f/0xbead52e175fc3c26 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad95 expref: 9 pid: 8399 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869702.059608:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 106 00000100:00100000:2.0:1788869702.059618:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+9:2387:x1875765545247488:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869702.059650:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869702.059674:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000efe8350f/0xbead52e175fc3c26 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad95 expref: 9 pid: 8399 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.059688:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000efe8350f/0xbead52e175fc3c26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad95 expref: 9 pid: 8399 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.059710:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efe8350f/0xbead52e175fc3c26 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad95 expref: 9 pid: 8399 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.059726:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869702.059731:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869702.059737:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e683d0e8/0xbead52e175fc3c49 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.059748:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e683d0e8/0xbead52e175fc3c49 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.059782:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869702.059843:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4fff62-1855-4361-a244-1a23eb291d37+8:2387:x1875765545247488:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 226us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869702.059850:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 106 00010000:00010000:1.0:1788869702.060140:0:14581:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e683d0e8/0xbead52e175fc3c49 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.060150:0:14581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e683d0e8/0xbead52e175fc3c49 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.060170:0:14581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e683d0e8/0xbead52e175fc3c49 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.060178:0:14581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e683d0e8/0xbead52e175fc3c49 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.060198:0:14581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e683d0e8/0xbead52e175fc3c49 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.060206:0:14581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1400 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:1.0:1788869702.060210:0:14581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e683d0e8/0xbead52e175fc3c49 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.060220:0:14581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e683d0e8/0xbead52e175fc3c49 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.060234:0:14581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e683d0e8/0xbead52e175fc3c49 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.060242:0:14581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e683d0e8/0xbead52e175fc3c49 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869702.060331:0:14581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf4fff62-1855-4361-a244-1a23eb291d37+7:2387:x1875765545247360:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 Request processed in 5615us (6116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869702.060340:0:14581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00100000:1.0:1788869702.065175:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869702.065627:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545247744 00000100:00100000:3.0:1788869702.065637:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545247744 00000100:00100000:3.0:1788869702.065746:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 247 00000100:00100000:3.0:1788869702.065758:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+21:12459:x1875765545247744:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788869702.065851:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c50 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.065868:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3b3f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad41 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.065880:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c50 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.065918:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3b3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad41 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.065933:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3b3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad41 expref: 21 pid: 6484 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869702.065948:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6485:1875765554731008:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869702.066038:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2840 going to sleep for 11 seconds 00000100:00100000:1.0:1788869702.068461:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6485:1875765554731008:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788869702.068491:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c50 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869702.070382:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869702.070507:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545247872 00000100:00100000:1.0:1788869702.070531:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545247872 00010000:00010000:1.0:1788869702.070573:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3b3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad41 expref: 22 pid: 6484 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869702.070617:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 107 00000100:00100000:1.0:1788869702.070627:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff89dab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+22:2387:x1875765545247872:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869702.070643:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869702.070650:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3b3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad41 expref: 22 pid: 6484 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.070664:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3b3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad41 expref: 22 pid: 6484 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.070689:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0200/0xbead52e175fc3b3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad41 expref: 22 pid: 6484 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.070705:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:1.0:1788869702.070712:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3ba1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad64 expref: 21 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.070722:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c50 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.070730:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.070738:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c50 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.070784:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869702.070833:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff89dab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4fff62-1855-4361-a244-1a23eb291d37+21:2387:x1875765545247872:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 206us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869702.070841:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 107 00010000:00010000:3.0:1788869702.070935:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.070945:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.071114:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c57 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.071138:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3c0a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad80 expref: 21 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.071147:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c57 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.071177:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3c0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad80 expref: 21 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.071190:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3c0a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad80 expref: 21 pid: 9496 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869702.071203:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6485:1875765554731136:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869702.071288:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2840 going to sleep for 11 seconds 00000100:00100000:0.0:1788869702.075982:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869702.076079:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545248000 00000100:00100000:2.0:1788869702.076088:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545248000 00010000:00010000:2.0:1788869702.076131:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3c0a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad80 expref: 22 pid: 9496 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869702.076195:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 108 00000100:00100000:2.0:1788869702.076205:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84025180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+22:2388:x1875765545248000:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869702.076222:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869702.076230:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3c0a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad80 expref: 22 pid: 9496 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.076243:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3c0a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad80 expref: 22 pid: 9496 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.076304:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99ff98fad100) 00010000:00010000:2.0:1788869702.076310:0:6471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c57 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.076319:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c57 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.076327:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c57 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.076347:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869702.076395:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84025180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4fff62-1855-4361-a244-1a23eb291d37+22:2388:x1875765545248000:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 191us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869702.076402:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 108 00010000:00010000:3.0:1788869702.077089:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80030000/0xbead52e175fc3c0a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad80 expref: 21 pid: 9496 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869702.077110:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6485:1875765554731136:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869702.077132:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c57 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.077142:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c57 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.077148:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c57 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788869702.077304:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1788869702.077554:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1788869702.077594:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1788869702.077679:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6485:1875765554731264:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788869702.077732:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869702.077818:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869702.078908:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554731264 00000100:00100000:2.0:1788869702.078918:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554731264 00000100:00100000:2.0:1788869702.078983:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788869702.078992:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6485:x1875765554731264:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788869702.079110:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6485:x1875765554731264:12345-0@lo:1000:mdt00_001.0 Request processed in 118us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869702.079117:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788869702.079298:0:6485:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:3.0:1788869702.079305:0:6485:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:3.0:1788869702.079323:0:6485:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffbfa49880, transno 4294967322 00000004:00080000:3.0:1788869702.079331:0:6485:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ffbfa4b480, transno 4294967323 00000100:00100000:3.0:1788869702.079337:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6485:1875765554731264:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788869702.079733:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1788869702.079786:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6485:1875765554731392:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788869702.079824:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869702.079854:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe822a2480 going to sleep for 11 seconds 00000100:00100000:0.0:1788869702.079916:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554731392 00000100:00100000:0.0:1788869702.079921:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554731392 00000100:00100000:0.0:1788869702.079966:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788869702.079973:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6485:x1875765554731392:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788869702.080079:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6485:x1875765554731392:12345-0@lo:1000:mdt00_001.0 Request processed in 106us (253us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788869702.080086:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788869702.080217:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6485:1875765554731392:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788869702.080282:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c57 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.080293:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c57 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.080301:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c57 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.080307:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9ee00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869702.080311:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c57 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.080319:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c57 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.080335:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99ff98fad100) 00010000:00010000:1.0:1788869702.080338:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869702.080343:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c57 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.080348:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c57 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.080369:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3b9a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.080386:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3b9a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.080392:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3b9a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.080397:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9f400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869702.080401:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3b9a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.080407:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3b9a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.080414:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:1.0:1788869702.080416:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869702.080422:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3ba1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad64 expref: 24 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.080445:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3ba1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad64 expref: 24 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.080462:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3ba1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad64 expref: 24 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.080486:0:6485:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3ba1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad64 expref: 24 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869702.080497:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa49880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6485:1875765554731520:192.168.201.30@tcp:105: 00000100:00100000:1.0:1788869702.080563:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe832afc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869702.084211:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa49880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6485:1875765554731520:192.168.201.30@tcp:105: 00010000:00010000:1.0:1788869702.084242:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3b9a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.084293:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3b9a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.084329:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3c5e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.084343:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3c5e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.084355:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3c5e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.084365:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3c5e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.084372:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3c5e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.084379:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3c5e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.084385:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869702.084389:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3c5e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.084396:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3c5e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.084434:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:1.0:1788869702.084438:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869702.084442:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3c5e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.084455:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc3c5e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.084466:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.084472:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c50 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.084477:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c50 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.084482:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9e800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869702.084485:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c50 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.084490:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c50 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.084497:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:1.0:1788869702.084500:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788869702.084503:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c50 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869702.084508:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c50 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869702.084682:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+24:12459:x1875765545247744:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 18926us (19515us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1788869702.084693:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 247 00000020:00080000:1.0:1788869702.084699:0:6485:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788869702.085407:0:13761:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869702.085413:0:13761:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869702.085906:0:13761:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788869702.085915:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788869702.089373:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869702.089587:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545248128 00000100:00100000:3.0:1788869702.089597:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545248128 00000100:00100000:3.0:1788869702.089656:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:3.0:1788869702.089667:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+24:12458:x1875765545248128:12345-192.168.201.30@tcp:49:lfs.0 00000100:00100000:3.0:1788869702.089802:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+24:12458:x1875765545248128:12345-192.168.201.30@tcp:49:lfs.0 Request processed in 136us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869702.089810:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:0.0:1788869702.092841:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869702.092929:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545248384 00000100:00100000:1.0:1788869702.092939:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545248384 00000100:00100000:1.0:1788869702.093001:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 248 00000100:00100000:1.0:1788869702.093012:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+24:12458:x1875765545248384:12345-192.168.201.30@tcp:58:lfs.0 00000040:00080000:1.0:1788869702.093184:0:9496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1788869702.093297:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+24:12458:x1875765545248384:12345-192.168.201.30@tcp:58:lfs.0 Request processed in 286us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869702.093304:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 248 00000100:00100000:1.0:1788869702.099753:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869702.099846:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545248640 00000100:00100000:3.0:1788869702.099856:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545248640 00000100:00100000:3.0:1788869702.099916:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:3.0:1788869702.100045:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff87cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+24:12459:x1875765545248640:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788869702.100335:0:6487:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788869702.100361:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1788869702.100405:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3c65 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.100420:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3c65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.100613:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3c65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.100621:0:6487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3c65 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.100627:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3c65 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.100633:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3c65 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.106201:0:6487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788869702.106351:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff87cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+26:12459:x1875765545248640:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 6420us (6603us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788869702.106362:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 62 00000020:00080000:2.0:1788869702.106368:0:6487:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788869702.107480:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869702.107491:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3c65 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.107502:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9f600 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869702.107506:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3c65 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.107516:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3c65 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.107532:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99ff98fad100) 00010000:00010000:3.0:1788869702.107535:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788869702.107540:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3c65 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.107574:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3c65 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.107594:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869702.107596:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869702.107598:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869702.139479:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869702.139833:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545248768 00000100:00100000:3.0:1788869702.139844:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545248768 00000100:00100000:3.0:1788869702.139957:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 249 00000100:00100000:3.0:1788869702.139968:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+26:12461:x1875765545248768:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869702.139993:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869702.140017:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3c6c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaad9c expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.140091:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c73 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.140106:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.140118:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.140134:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3c7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.140141:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3c7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.140148:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3c7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.140241:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.140286:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b8c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad5d expref: 27 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.140295:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c81 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.140331:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b8c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad5d expref: 27 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.140346:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b8c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad5d expref: 27 pid: 12967 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869702.140362:0:6484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6484:1875765554731648:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869702.140464:0:6484:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff88e3ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869702.148087:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869702.148202:0:6484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6484:1875765554731648:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869702.148234:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869702.148400:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545249024 00000100:00100000:1.0:1788869702.148409:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545249024 00000100:00100000:1.0:1788869702.148490:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:1.0:1788869702.148500:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+28:6153:x1875765545249024:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788869702.148729:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+29:6153:x1875765545249024:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 230us (653us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788869702.148738:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:1.0:1788869702.151615:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869702.151701:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545249152 00000100:00100000:3.0:1788869702.151710:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545249152 00010000:00010000:3.0:1788869702.151749:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b8c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad5d expref: 29 pid: 12967 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869702.151793:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 109 00000100:00100000:3.0:1788869702.151816:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+29:2387:x1875765545249152:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869702.151833:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869702.151840:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b8c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad5d expref: 29 pid: 12967 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.151855:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b8c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad5d expref: 29 pid: 12967 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.151879:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3b8c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad5d expref: 29 pid: 12967 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.151897:0:9488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:3.0:1788869702.151902:0:9488:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.151911:0:9488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.151919:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c81 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869702.151954:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869702.152010:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bf4fff62-1855-4361-a244-1a23eb291d37+28:2387:x1875765545249152:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 195us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869702.152018:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 109 00010000:00010000:2.0:1788869702.152096:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.152105:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869702.152159:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788869702.152164:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869702.152185:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.152200:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.152211:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.152219:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c73 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.152234:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.152241:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9e800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869702.152246:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.152302:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c73 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.152313:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:2.0:1788869702.152316:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869702.152321:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c73 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.152328:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9e800/0xbead52e175fc3c73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.152339:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3c7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.152345:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3c7a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.152351:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3c7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.152356:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9f400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869702.152359:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3c7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.152375:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3c7a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.152384:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99ffb982d800) 00010000:00010000:2.0:1788869702.152387:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869702.152389:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3c7a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.152395:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f400/0xbead52e175fc3c7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.152442:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3c6c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad9c expref: 28 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.152466:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad9c expref: 27 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869702.152473:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:2.0:1788869702.152475:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869702.152478:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9ee00, rc 0) 00000100:00100000:2.0:1788869702.152504:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+27:12461:x1875765545248768:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 12539us (13068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869702.152512:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 249 00010000:00010000:3.0:1788869702.687119:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788869703.048031:0:14722:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788869703.048045:0:14722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788869703.048476:0:14722:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788869703.048558:0:14722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788869703.129907:0:13761:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869703.129921:0:13761:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869703.129959:0:13761:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788869703.129966:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788869703.130133:0:13761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84041c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1875765554731776:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788869703.130420:0:13761:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae73f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869703.139507:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869703.139769:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545249280 00000100:00100000:0.0:1788869703.139784:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545249280 00000100:00100000:0.0:1788869703.139856:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 250 00000100:00100000:0.0:1788869703.139880:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+28:12473:x1875765545249280:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788869703.139930:0:6485:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788869703.140073:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+28:12473:x1875765545249280:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 195us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869703.140082:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 250 00000100:00100000:1.0:1788869703.141963:0:13761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84041c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13761:1875765554731776:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788869703.145410:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869703.145458:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545249536 00000100:00100000:2.0:1788869703.145468:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545249536 00000100:00100000:2.0:1788869703.145547:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 251 00000100:00100000:2.0:1788869703.145558:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+27:12473:x1875765545249536:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869703.145585:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869703.145611:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3c88 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaada3 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869703.145741:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3c8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869703.145758:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3c8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869703.145774:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3c8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869703.145788:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788869703.145916:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0c00/0xbead52e175fc3c88 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaada3 expref: 30 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869703.145937:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3c8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaada3 expref: 29 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869703.145946:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:2.0:1788869703.145949:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869703.145953:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1800, rc 0) 00000100:00100000:2.0:1788869703.146027:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+29:12473:x1875765545249536:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 472us (631us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788869703.146035:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 251 00000100:00100000:0.0:1788869703.150793:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869703.150891:0:9487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545249664 00000100:00100000:3.0:1788869703.150904:0:9487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545249664 00000100:00100000:3.0:1788869703.150988:0:9487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:3.0:1788869703.151002:0:9487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84026d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4fff62-1855-4361-a244-1a23eb291d37+29:2390:x1875765545249664:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869703.151023:0:9487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869703.151056:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1800/0xbead52e175fc3c8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaada3 expref: 29 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869703.151075:0:9487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:3.0:1788869703.151081:0:9487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869703.151154:0:9487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84026d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4fff62-1855-4361-a244-1a23eb291d37+28:2390:x1875765545249664:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 155us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869703.151163:0:9487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:2.0:1788869703.156763:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869703.156848:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545249920 00000100:00100000:3.0:1788869703.156862:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545249920 00000100:00100000:3.0:1788869703.157668:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 252 00000100:00100000:3.0:1788869703.157684:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+28:12473:x1875765545249920:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788869703.157799:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3c9d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869703.157823:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3c9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869703.157837:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3c9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869703.158038:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3c9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869703.158059:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3c9d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869703.158067:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3c9d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869703.158074:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fe00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869703.158080:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3c9d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869703.158088:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3c9d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869703.158103:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:3.0:1788869703.158107:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788869703.158177:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3c9d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869703.158185:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3c9d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869703.158359:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+29:12473:x1875765545249920:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 678us (1609us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788869703.158369:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 252 00000040:00080000:1.0:1788869703.159994:0:13761:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788869703.160004:0:13761:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788869703.165149:0:13761:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788869703.165189:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788869703.169748:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869703.169853:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545250176 00000100:00100000:1.0:1788869703.169868:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545250176 00000100:00100000:1.0:1788869703.169941:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:1.0:1788869703.169954:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+29:12473:x1875765545250176:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788869703.170292:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bf4fff62-1855-4361-a244-1a23eb291d37+30:12473:x1875765545250176:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 340us (556us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1788869703.170302:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:3.0:1788869703.277087:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869703.281697:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545250304 00000100:00100000:0.0:1788869703.281718:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545250304 00000100:00100000:0.0:1788869703.281799:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 390 00000100:00100000:0.0:1788869703.281810:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2388:x1875765545250304:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869703.281945:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2388:x1875765545250304:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 137us (5551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869703.281954:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 390 00000100:00100000:2.0:1788869703.287010:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869703.287050:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869703.287083:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869703.287108:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869703.287151:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869703.287183:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545250432 00000100:00100000:2.0:1788869703.287196:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545250432 00000100:00100000:2.0:1788869703.287309:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545250944 00000100:00100000:2.0:1788869703.287313:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545250944 00000100:00100000:2.0:1788869703.287332:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545250816 00000100:00100000:2.0:1788869703.287335:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545250816 00000100:00100000:2.0:1788869703.287353:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 338 00000100:00100000:2.0:1788869703.287363:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+5:2388:x1875765545250432:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869703.287483:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+5:2388:x1875765545250432:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 120us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869703.287491:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 338 00000100:00100000:2.0:1788869703.287509:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 339 00000100:00100000:2.0:1788869703.287516:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545250944:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869703.287541:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545250944:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869703.287547:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 339 00000100:00100000:2.0:1788869703.287558:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 340 00000100:00100000:2.0:1788869703.287564:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545250816:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869703.287602:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2387:x1875765545250816:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 38us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869703.287609:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 340 00000100:00100000:2.0:1788869703.287629:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545250688 00000100:00100000:2.0:1788869703.287632:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545250688 00000100:00100000:2.0:1788869703.287659:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545250560 00000100:00100000:2.0:1788869703.287662:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545250560 00000100:00100000:2.0:1788869703.287679:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 139 00000100:00100000:2.0:1788869703.287685:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545250688:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869703.287709:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:2387:x1875765545250688:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869703.287716:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 139 00000100:00100000:2.0:1788869703.287727:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 140 00000100:00100000:2.0:1788869703.287733:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+7:2387:x1875765545250560:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869703.287755:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bf4fff62-1855-4361-a244-1a23eb291d37+7:2387:x1875765545250560:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869703.287761:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 140 00000100:00080000:2.0:1788869703.287782:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869703.287788:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869703.287790:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869703.576557:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554731904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869703.576670:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869703.578639:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554731904 00000100:00100000:3.0:1788869703.578657:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554731904 00000100:00100000:3.0:1788869703.578757:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788869703.578774:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875765554731904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869703.578841:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788869703.578952:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875765554731904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (2283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869703.578961:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788869703.579247:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869703.579284:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554732032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869703.579336:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869703.579431:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554732032 00000100:00100000:1.0:1788869703.579438:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554732032 00000100:00100000:1.0:1788869703.579487:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788869703.579497:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554732032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869703.579511:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788869703.579553:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554732032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869703.579560:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788869703.579609:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554732032:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788869703.579776:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869703.579809:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554731904:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788869703.704579:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869704.088646:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554732160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869704.088733:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869704.088867:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554732160 00000100:00100000:0.0:1788869704.088876:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554732160 00000100:00100000:0.0:1788869704.088933:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788869704.088946:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554732160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869704.089240:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788869704.089318:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554732160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 378us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869704.089324:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788869704.089406:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554732160:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788869704.730768:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788869704.820500:0:14773:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788869704.820508:0:14773:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788869704.820540:0:14773:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788869704.820546:0:14773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788869705.011882:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869705.012003:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545251200 00000100:00100000:2.0:1788869705.012015:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545251200 00000100:00100000:2.0:1788869705.012094:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 253 00000100:00100000:2.0:1788869705.012102:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+30:12494:x1875765545251200:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1788869705.012130:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869705.012149:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3ca4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaadaa expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788869705.012348:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788869705.012415:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc3cab lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869705.012428:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc3cab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869705.012548:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc3cab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869705.012564:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788869705.012679:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1c00/0xbead52e175fc3ca4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaadaa expref: 33 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869705.012698:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc3cab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaadaa expref: 32 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869705.012707:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:2.0:1788869705.012710:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788869705.012714:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1a00, rc 0) 00000100:00100000:2.0:1788869705.012827:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+32:12494:x1875765545251200:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 724us (954us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788869705.012850:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 253 00000100:00100000:2.0:1788869705.016095:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869705.016242:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545251328 00000100:00100000:3.0:1788869705.016408:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545251328 00000100:00100000:3.0:1788869705.016589:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 254 00000100:00100000:3.0:1788869705.016600:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+32:12494:x1875765545251328:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:3.0:1788869705.016674:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3cb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869705.016691:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869705.016703:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869705.016738:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869705.016746:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3cb9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869705.016753:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869705.016759:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fe00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869705.016763:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869705.016788:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3cb9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869705.016801:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:3.0:1788869705.016804:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869705.016810:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3cb9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869705.016816:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3cb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869705.016900:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+32:12494:x1875765545251328:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 301us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869705.016908:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 254 00000100:00100000:0.0:1788869705.145052:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869705.145193:0:14581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545251456 00000100:00100000:1.0:1788869705.145203:0:14581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545251456 00000100:00100000:1.0:1788869705.145327:0:14581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 80 00000100:00100000:1.0:1788869705.145338:0:14581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf4fff62-1855-4361-a244-1a23eb291d37+7:2387:x1875765545251456:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:1.0:1788869705.145357:0:14581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869705.145382:0:14581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d7ad86d/0xbead52e175fc3cc0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaadb1 expref: -99 pid: 14581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788869705.145410:0:14581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9ffc45, atime: 0x6a9ffc45, ctime: 0x6a9ffc45, blocks: 0x8 00010000:00010000:1.0:1788869705.145442:0:14581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=323s v=(0 0) 00010000:00010000:1.0:1788869705.145448:0:14581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869705.145466:0:14581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d7ad86d/0xbead52e175fc3cc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaadb1 expref: 8 pid: 14581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869705.145486:0:14581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005d7ad86d/0xbead52e175fc3cc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaadb1 expref: 8 pid: 14581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869705.145501:0:14581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80031e00, rc 0) 00000100:00100000:1.0:1788869705.145567:0:14581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf4fff62-1855-4361-a244-1a23eb291d37+8:2387:x1875765545251456:12345-192.168.201.30@tcp:101:cat.0 Request processed in 231us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869705.145574:0:14581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 80 00000100:00080000:0.0:1788869705.146098:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869705.149491:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869705.149608:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545251584 00000100:00100000:2.0:1788869705.149618:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545251584 00002000:00100000:2.0:1788869705.149669:0:8404:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff99fe84024e00 x1875765545251584/t0(0) o3->bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp:651/0 lens 488/0 e 0 to 0 dl 1788869716 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788869705.149681:0:8404:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99fe84024e00 with x1875765545251584 ext(0->4095) 00002000:00010000:2.0:1788869705.149686:0:8404:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fe84024e00 00000100:00100000:2.0:1788869705.149731:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:2.0:1788869705.149740:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf4fff62-1855-4361-a244-1a23eb291d37+8:2390:x1875765545251584:12345-192.168.201.30@tcp:3:cat.0 00000100:00100000:2.0:1788869705.149967:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bf4fff62-1855-4361-a244-1a23eb291d37+8:2390:x1875765545251584:12345-192.168.201.30@tcp:3:cat.0 Request processed in 225us (483us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788869705.149977:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00002000:00100000:2.0:1788869705.149986:0:8404:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff99fe84024e00 x1875765545251584/t0(0) o3->bf4fff62-1855-4361-a244-1a23eb291d37@192.168.201.30@tcp:651/0 lens 488/4536 e 0 to 0 dl 1788869716 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788869705.149995:0:8404:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99fe84024e00 with x1875765545251584 ext(0->4095) 00002000:00010000:2.0:1788869705.149999:0:8404:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99fe84024e00 00010000:00010000:3.0:1788869705.752492:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788869706.014742:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788869706.136491:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554732288:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869706.136567:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869706.137119:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554732416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869706.137154:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869706.137192:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554732288 00000100:00100000:2.0:1788869706.137198:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554732288 00000100:00100000:2.0:1788869706.137246:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788869706.137277:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554732288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869706.137312:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788869706.137360:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554732288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869706.137368:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788869706.137463:0:13961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554732416 00000100:00100000:2.0:1788869706.137468:0:13961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554732416 00000100:00100000:2.0:1788869706.137506:0:13961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788869706.137513:0:13961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554732416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869706.137534:0:13961:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869706.137568:0:13961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554732416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869706.137575:0:13961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:2.0:1788869706.137594:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869706.137630:0:3617:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788869706.137637:0:3617:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:2.0:1788869706.137671:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fe84027480, transno 4294967308 00000004:00080000:2.0:1788869706.137682:0:3617:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1788869706.137693:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99fe84043800, transno 4294967311 00000100:00100000:2.0:1788869706.137705:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554732416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869706.138174:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554732288:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788869706.267332:0:13761:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788869706.267343:0:13761:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788869706.267364:0:13761:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788869706.267372:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788869706.648622:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554732544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869706.648700:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869706.648832:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554732544 00000100:00100000:0.0:1788869706.648843:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554732544 00000100:00100000:0.0:1788869706.648910:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788869706.648920:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554732544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869706.648942:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788869706.648993:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554732544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869706.649000:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788869706.649044:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554732544:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788869706.649149:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869706.652401:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869706.652539:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869706.652562:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554733056:0@lo:400:kworker.0 00000100:00100000:1.0:1788869706.652634:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869706.652707:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554732800:0@lo:400:kworker.0 00000100:00100000:1.0:1788869706.652735:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869706.652755:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869706.652760:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554732928:0@lo:400:kworker.0 00000100:00100000:1.0:1788869706.652780:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869706.652816:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554732800 00000100:00100000:1.0:1788869706.652824:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554732800 00000100:00100000:1.0:1788869706.652873:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554732928 00000100:00100000:1.0:1788869706.652877:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554732928 00000100:00100000:1.0:1788869706.652898:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788869706.652906:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554732800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869706.652956:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554732800:12345-0@lo:400:kworker.0 Request processed in 50us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869706.652964:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788869706.652981:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788869706.652987:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554732928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869706.653014:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554732928:12345-0@lo:400:kworker.0 Request processed in 27us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869706.653020:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788869706.653057:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554732928:0@lo:400:kworker.0 00000100:00100000:1.0:1788869706.653068:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554732800:0@lo:400:kworker.0 00000100:00100000:0.0:1788869706.653246:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554732672:0@lo:400:kworker.0 00000100:00100000:0.0:1788869706.653311:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869706.653545:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554733056 00000100:00100000:0.0:1788869706.653551:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554733056 00000100:00100000:0.0:1788869706.653586:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788869706.653593:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554733056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869706.653635:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554733056:12345-0@lo:400:kworker.0 Request processed in 42us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869706.653641:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788869706.653672:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554733056:0@lo:400:kworker.0 00000100:00100000:3.0:1788869706.653843:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554732672 00000100:00100000:3.0:1788869706.653847:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554732672 00000100:00100000:3.0:1788869706.653882:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1788869706.653889:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554732672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869706.653944:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554732672:12345-0@lo:400:kworker.0 Request processed in 56us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869706.653964:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1788869706.654076:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554732672:0@lo:400:kworker.0 00000100:00100000:0.0:1788869706.654553:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554733184:0@lo:400:kworker.0 00000100:00100000:0.0:1788869706.654591:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869706.654700:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554733312:0@lo:400:kworker.0 00000100:00100000:1.0:1788869706.654728:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869706.654748:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869706.654763:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554733440:0@lo:400:kworker.0 00000100:00100000:1.0:1788869706.654789:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869706.654819:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554733184 00000100:00100000:1.0:1788869706.654823:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554733184 00000100:00100000:1.0:1788869706.654860:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554733312 00000100:00100000:1.0:1788869706.654863:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554733312 00000100:00100000:1.0:1788869706.654884:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788869706.654892:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554733184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869706.654962:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1788869706.654970:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554733312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869706.655009:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554733312:12345-0@lo:400:kworker.0 Request processed in 40us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869706.655015:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788869706.655107:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869706.655117:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554733824:0@lo:400:kworker.0 00000100:00100000:2.0:1788869706.655147:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869706.655218:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554733824 00000100:00100000:3.0:1788869706.655222:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554733824 00000100:00100000:3.0:1788869706.655277:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788869706.655284:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875765554733824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869706.655319:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875765554733824:12345-0@lo:400:kworker.0 Request processed in 35us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869706.655325:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00010000:00080000:2.0:1788869706.655398:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe81c8df80 x1875765554733824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869706.655412:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554733824:0@lo:400:kworker.0 00000100:00100000:1.0:1788869706.655494:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554733184:12345-0@lo:400:kworker.0 Request processed in 603us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869706.655501:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788869706.655519:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554733440 00000100:00100000:1.0:1788869706.655522:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554733440 00000100:00100000:1.0:1788869706.655557:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788869706.655564:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554733440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869706.655596:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554733440:12345-0@lo:400:kworker.0 Request processed in 33us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869706.655602:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788869706.655629:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554733440:0@lo:400:kworker.0 00010000:00080000:1.0:1788869706.655639:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe81c8f800 x1875765554733312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869706.655648:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554733312:0@lo:400:kworker.0 00000100:00080000:1.0:1788869706.655671:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869706.655676:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869706.655677:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869706.655686:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554733568:0@lo:400:kworker.0 00000100:00100000:1.0:1788869706.655711:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869706.655791:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869706.655797:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554733696:0@lo:400:kworker.0 00000100:00100000:1.0:1788869706.655819:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869706.655843:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554733696 00000100:00100000:1.0:1788869706.655847:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554733696 00000100:00100000:1.0:1788869706.655875:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788869706.655880:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554733696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869706.655911:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554733696:12345-0@lo:400:kworker.0 Request processed in 31us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869706.655916:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00080000:1.0:1788869706.655929:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869706.655946:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554733696:0@lo:400:kworker.0 00000100:00100000:3.0:1788869706.656011:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554733568 00000100:00100000:3.0:1788869706.656015:0:8527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554733568 00000100:00100000:3.0:1788869706.656051:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788869706.656058:0:8527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3618:x1875765554733568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869706.656093:0:8527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3618:x1875765554733568:12345-0@lo:400:kworker.0 Request processed in 35us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869706.656099:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1788869706.656149:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869706.656167:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554733568:0@lo:400:kworker.0 00000100:00100000:0.0:1788869706.656642:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554733184:0@lo:400:kworker.0 00010000:00010000:2.0:1788869706.777077:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869707.800938:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788869708.187661:0:8393:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:3.0:1788869708.187681:0:8393:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1788869708.188356:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1788869708.188394:0:6463:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99fe822a2e40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788869708.188401:0:6463:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99ff89e2e100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99fe822a2900 00000020:00080000:0.0:1788869708.188405:0:6463:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99ff89e2e600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99fe84092c00 00000020:00080000:0.0:1788869708.188436:0:6463:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1788869708.188497:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788869708.188584:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1788869708.189579:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3c3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869708.189596:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3c3b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869708.189618:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3c3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869708.189625:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05c00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869708.189630:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3c3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869708.189639:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3c3b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869708.189662:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99ff98fad100) 00010000:00010000:3.0:1788869708.189665:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869708.189670:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3c3b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869708.189677:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05c00/0xbead52e175fc3c3b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869708.393226:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869708.393331:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869708.393364:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869708.393389:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869708.393410:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869708.393429:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869708.393455:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869708.393499:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545251968 00000100:00100000:3.0:1788869708.393511:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545251968 00000100:00100000:3.0:1788869708.393589:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545252480 00000100:00100000:3.0:1788869708.393592:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545252480 00000100:00100000:3.0:1788869708.393608:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545251840 00000100:00100000:3.0:1788869708.393625:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545251840 00000100:00100000:3.0:1788869708.393642:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545252352 00000100:00100000:3.0:1788869708.393644:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545252352 00000100:00100000:3.0:1788869708.393661:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 347 00000100:00100000:3.0:1788869708.393673:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545251968:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869708.395191:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545251712 00000100:00100000:2.0:1788869708.395205:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545251712 00000100:00100000:2.0:1788869708.395285:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 392 00000100:00100000:2.0:1788869708.395296:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2389:x1875765545251712:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869708.395407:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545251968:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 1734us (2073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869708.395418:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 347 00000100:00100000:3.0:1788869708.395446:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 348 00000100:00100000:3.0:1788869708.395455:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545252480:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869708.400330:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2389:x1875765545251712:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 5018us (7142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869708.400351:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 392 00000100:00100000:2.0:1788869708.402386:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545252224 00000100:00100000:2.0:1788869708.402407:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545252224 00000100:00100000:2.0:1788869708.402496:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545252096 00000100:00100000:2.0:1788869708.402500:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545252096 00000100:00100000:2.0:1788869708.402543:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 143 00000100:00100000:2.0:1788869708.402557:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545252224:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869708.402676:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2389:x1875765545252224:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 122us (9310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869708.402683:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 143 00000100:00100000:2.0:1788869708.402742:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 144 00000100:00100000:2.0:1788869708.402750:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+7:2389:x1875765545252096:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869708.402788:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+7:2389:x1875765545252096:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 38us (9357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869708.402795:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 144 00000100:00100000:2.0:1788869708.402821:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 349 00000100:00100000:2.0:1788869708.402830:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+18:2389:x1875765545251840:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869708.402882:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+18:2389:x1875765545251840:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 54us (9471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869708.403107:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 349 00000100:00100000:2.0:1788869708.403130:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 350 00000100:00100000:2.0:1788869708.403139:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545252352:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869708.403166:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545252352:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 30us (9711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869708.403172:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 350 00000100:00080000:2.0:1788869708.404372:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788869708.404383:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869708.404392:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869708.404396:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869708.406614:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2389:x1875765545252480:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 11140us (13203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869708.406632:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 348 00000100:00100000:3.0:1788869708.696611:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869708.696650:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554733952:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869708.696894:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869708.697059:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554733952 00000100:00100000:1.0:1788869708.697071:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554733952 00000100:00100000:1.0:1788869708.697158:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788869708.697168:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554733952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869708.697208:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788869708.697295:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554733952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869708.697303:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788869708.697366:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554733952:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788869708.697833:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869708.704049:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869708.704094:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554734080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869708.704202:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869708.705040:0:13961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554734080 00000100:00100000:3.0:1788869708.705053:0:13961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554734080 00000100:00100000:3.0:1788869708.705176:0:13961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788869708.705189:0:13961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554734080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869708.705225:0:13961:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788869708.705799:0:13961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554734080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 610us (1593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869708.705809:0:13961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788869708.705981:0:3619:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1788869708.705989:0:3619:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1788869708.706046:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554734080:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788869708.706469:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788869708.827187:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869709.211545:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869709.211577:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554734208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869709.211676:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869709.211763:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554734208 00000100:00100000:3.0:1788869709.211773:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554734208 00000100:00100000:3.0:1788869709.211832:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788869709.211844:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554734208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869709.211893:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788869709.211952:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554734208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869709.211961:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788869709.212029:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554734208:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788869709.857168:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869709.922238:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869709.922573:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545252608 00000100:00100000:2.0:1788869709.922588:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545252608 00000100:00100000:2.0:1788869709.922740:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 255 00000100:00100000:2.0:1788869709.922751:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+18:12139:x1875765545252608:12345-192.168.201.30@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788869709.924172:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bf4fff62-1855-4361-a244-1a23eb291d37+18:12139:x1875765545252608:12345-192.168.201.30@tcp:60:lhsmtool_posix.0 Request processed in 1413us (1938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869709.924186:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 255 00000100:00100000:0.0:1788869709.943029:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869709.943941:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545252736 00000100:00100000:2.0:1788869709.943956:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545252736 00000100:00100000:2.0:1788869709.944099:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 256 00000100:00100000:2.0:1788869709.944137:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+5:12139:x1875765545252736:12345-192.168.201.30@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788869709.944318:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bf4fff62-1855-4361-a244-1a23eb291d37+5:12139:x1875765545252736:12345-192.168.201.30@tcp:60:lhsmtool_posix.0 Request processed in 184us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869709.944327:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 256 00000100:00100000:3.0:1788869709.956531:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869709.957704:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545252992 00000100:00100000:2.0:1788869709.957721:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545252992 00000100:00100000:2.0:1788869709.957865:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:2.0:1788869709.957878:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+18:12139:x1875765545252992:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788869709.959785:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+19:12139:x1875765545252992:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 1898us (3257us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788869709.959808:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:1.0:1788869710.095105:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869710.095337:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545253120 00000100:00100000:3.0:1788869710.095353:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545253120 00000100:00100000:3.0:1788869710.095471:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 257 00000100:00100000:3.0:1788869710.095485:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+5:12951:x1875765545253120:12345-192.168.201.30@tcp:101:lsof.0 00010000:00010000:3.0:1788869710.095513:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869710.095560:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3cc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaadb8 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869710.095647:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3cce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869710.095663:0:12967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3cce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869710.095702:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3cce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869710.095769:0:12967:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788869710.095773:0:12967:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869710.095797:0:12967:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3cce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869710.095826:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fe00/0xbead52e175fc3cc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaadb8 expref: 7 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869710.095848:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3cce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaadb8 expref: 6 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869710.095857:0:12967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff88bbf700) 00010000:00010000:3.0:1788869710.095861:0:12967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869710.095865:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9f600, rc 0) 00000100:00100000:3.0:1788869710.095962:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85067cd6-7cd1-4166-bc53-2e9768411f07+6:12951:x1875765545253120:12345-192.168.201.30@tcp:101:lsof.0 Request processed in 479us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869710.095970:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 257 00000100:00080000:2.0:1788869710.098907:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788869710.877835:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869711.259083:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869711.259117:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554734336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869711.259241:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869711.259367:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554734336 00000100:00100000:2.0:1788869711.259377:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554734336 00000100:00100000:3.0:1788869711.259776:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869711.259789:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554734464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869711.259834:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869711.260245:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788869711.260352:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554734464 00000100:00100000:1.0:1788869711.260377:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554734464 00000100:00100000:1.0:1788869711.260449:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788869711.260477:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554734464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788869711.260515:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869711.260579:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554734464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869711.260587:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788869711.260644:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554734464:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788869711.262033:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869711.267015:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff87cec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554734336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869711.267074:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788869711.267556:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff87cec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554734336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 577us (8313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869711.267566:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788869711.267777:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554734336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869711.768527:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554734592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869711.768604:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869711.769039:0:13961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554734592 00000100:00100000:2.0:1788869711.769049:0:13961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554734592 00000100:00100000:2.0:1788869711.769140:0:13961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788869711.769150:0:13961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554734592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788869711.769172:0:13961:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788869711.769246:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869711.769399:0:13961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554734592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 250us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869711.769407:0:13961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788869711.769500:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554734592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869711.772038:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554734720:0@lo:400:kworker.0 00000100:00100000:0.0:1788869711.772119:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869711.772169:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554735232:0@lo:400:kworker.0 00000100:00100000:0.0:1788869711.772198:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869711.772219:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875765554735744:0@lo:400:kworker.0 00000100:00100000:0.0:1788869711.772241:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869711.772292:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788869711.772300:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554735104:0@lo:400:kworker.0 00000100:00100000:0.0:1788869711.772326:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869711.772357:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554735616:0@lo:400:kworker.0 00000100:00100000:3.0:1788869711.772389:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554735104 00000100:00100000:0.0:1788869711.772391:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869711.772405:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554735104 00000100:00100000:0.0:1788869711.772435:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554734720 00000100:00100000:0.0:1788869711.772444:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554734720 00000100:00100000:3.0:1788869711.772496:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788869711.772513:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554735104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869711.772516:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1788869711.772529:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:3619:x1875765554734720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869711.772634:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46892796-b77d-4866-a7cc-ce4160dea4be+24:3619:x1875765554734720:12345-0@lo:400:kworker.0 Request processed in 106us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869711.772643:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1788869711.772655:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554735104:12345-0@lo:400:kworker.0 Request processed in 145us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869711.772666:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788869711.772690:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554734976:0@lo:400:kworker.0 00000100:00100000:0.0:1788869711.772721:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869711.772740:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554735488:0@lo:400:kworker.0 00000100:00100000:0.0:1788869711.772761:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869711.772778:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788869711.772784:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875765554734848:0@lo:400:kworker.0 00000100:00100000:0.0:1788869711.772806:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869711.772828:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554735360:0@lo:400:kworker.0 00000100:00100000:0.0:1788869711.772847:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869711.772863:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554735872:0@lo:400:kworker.0 00000100:00100000:0.0:1788869711.772883:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869711.772920:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554735104:0@lo:400:kworker.0 00000100:00100000:0.0:1788869711.772930:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554734720:0@lo:400:kworker.0 00000100:00100000:0.0:1788869711.772997:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554735232 00000100:00100000:0.0:1788869711.773001:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554735232 00000100:00100000:0.0:1788869711.773030:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554735744 00000100:00100000:0.0:1788869711.773032:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554735744 00000100:00100000:0.0:1788869711.773043:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554734976 00000100:00100000:0.0:1788869711.773046:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554734976 00000100:00100000:0.0:1788869711.773055:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554734848 00000100:00100000:0.0:1788869711.773057:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554734848 00000100:00100000:0.0:1788869711.773066:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554735360 00000100:00100000:0.0:1788869711.773069:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554735360 00000100:00100000:0.0:1788869711.773089:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554735872 00000100:00100000:0.0:1788869711.773091:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554735872 00000100:00100000:0.0:1788869711.773104:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788869711.773110:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554735232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869711.773146:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554735232:12345-0@lo:400:kworker.0 Request processed in 36us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869711.773153:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788869711.773166:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788869711.773171:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875765554735744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869711.773199:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875765554735744:12345-0@lo:400:kworker.0 Request processed in 27us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869711.773204:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788869711.773214:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788869711.773220:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554734976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869711.773248:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554734976:12345-0@lo:400:kworker.0 Request processed in 29us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869711.773280:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788869711.773292:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788869711.773299:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875765554734848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869711.773325:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875765554734848:12345-0@lo:400:kworker.0 Request processed in 27us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869711.773332:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788869711.773346:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788869711.773357:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554735360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869711.773394:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554735360:12345-0@lo:400:kworker.0 Request processed in 38us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869711.773401:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788869711.773417:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788869711.773423:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875765554735872:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788869711.773449:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869711.773456:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869711.773493:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875765554734848:0@lo:400:kworker.0 00000100:00100000:3.0:1788869711.773501:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875765554735872:12345-0@lo:400:kworker.0 Request processed in 85us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869711.773515:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00010000:00080000:0.0:1788869711.773515:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe839bf100 x1875765554735360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869711.773530:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554735360:0@lo:400:kworker.0 00010000:00080000:0.0:1788869711.773549:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8397f100 x1875765554735872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869711.773558:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554735872:0@lo:400:kworker.0 00000100:00100000:0.0:1788869711.773568:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554734976:0@lo:400:kworker.0 00000100:00100000:3.0:1788869711.773607:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554735232:0@lo:400:kworker.0 00000100:00100000:3.0:1788869711.773630:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875765554735744:0@lo:400:kworker.0 00000100:00100000:2.0:1788869711.773694:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554735616 00000100:00100000:2.0:1788869711.773700:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554735616 00000100:00100000:2.0:1788869711.773740:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554735488 00000100:00100000:2.0:1788869711.773743:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554735488 00000100:00100000:2.0:1788869711.773763:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788869711.773771:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554735616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869711.773820:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554735616:12345-0@lo:400:kworker.0 Request processed in 50us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869711.773827:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788869711.773839:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788869711.773845:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554735488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869711.773877:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554735488:12345-0@lo:400:kworker.0 Request processed in 32us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869711.773883:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788869711.773936:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554735488:0@lo:400:kworker.0 00000100:00100000:3.0:1788869711.774074:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554735616:0@lo:400:kworker.0 00000100:00080000:0.0:1788869711.775543:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788869711.896487:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869712.926588:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869713.517947:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869713.517995:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869713.518020:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869713.518040:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869713.518057:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869713.518073:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869713.518120:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869713.518161:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545253504 00000100:00100000:0.0:1788869713.518173:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545253504 00000100:00100000:0.0:1788869713.518277:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545254016 00000100:00100000:0.0:1788869713.518281:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545254016 00000100:00100000:0.0:1788869713.518298:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545253376 00000100:00100000:0.0:1788869713.518301:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545253376 00000100:00100000:0.0:1788869713.518334:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545253888 00000100:00100000:0.0:1788869713.518337:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545253888 00000100:00100000:0.0:1788869713.518355:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 357 00000100:00100000:0.0:1788869713.518365:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545253504:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869713.518762:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 358 00000100:00100000:2.0:1788869713.518775:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545254016:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869713.518838:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545253504:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 472us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869713.518847:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 357 00000100:00100000:0.0:1788869713.518869:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 359 00000100:00100000:0.0:1788869713.518876:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+19:2390:x1875765545253376:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869713.519641:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 360 00000100:00100000:1.0:1788869713.519657:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+6:2390:x1875765545253888:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869713.519951:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545253248 00000100:00100000:3.0:1788869713.519960:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545253248 00000100:00100000:3.0:1788869713.520007:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 394 00000100:00100000:3.0:1788869713.520015:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2390:x1875765545253248:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869713.520108:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2390:x1875765545254016:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 1335us (2063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869713.520116:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 358 00000100:00100000:2.0:1788869713.520157:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545253760 00000100:00100000:2.0:1788869713.520162:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545253760 00000100:00100000:2.0:1788869713.520199:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545253632 00000100:00100000:2.0:1788869713.520203:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545253632 00000100:00100000:2.0:1788869713.520227:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 147 00000100:00100000:2.0:1788869713.520233:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545253760:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869713.520280:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+5:2390:x1875765545253760:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 46us (2258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869713.520287:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 147 00000100:00100000:2.0:1788869713.520302:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 148 00000100:00100000:2.0:1788869713.520310:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+7:2390:x1875765545253632:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869713.520338:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bf4fff62-1855-4361-a244-1a23eb291d37+7:2390:x1875765545253632:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (2263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869713.520344:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 148 00000100:00100000:0.0:1788869713.522316:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bf4fff62-1855-4361-a244-1a23eb291d37+19:2390:x1875765545253376:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 3425us (4242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869713.522332:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 359 00000100:00100000:1.0:1788869713.523912:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+6:2390:x1875765545253888:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 4249us (5778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869713.523926:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 360 00000100:00080000:1.0:1788869713.523969:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869713.523976:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869713.523980:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869713.523984:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869713.524186:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2390:x1875765545253248:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 4169us (6251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869713.524198:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 394 00000001:02000400:3.0:1788869713.737083:0:14971:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:15:13 (1788869713) 00000100:00100000:3.0:1788869713.816568:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869713.816615:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8335d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554736000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869713.816655:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554736128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869713.818352:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869713.818582:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554736128 00000100:00100000:0.0:1788869713.818597:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554736128 00000100:00100000:0.0:1788869713.818664:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788869713.818673:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554736128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788869713.818718:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788869713.818803:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554736128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869713.818810:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:0.0:1788869713.818835:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869713.819130:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554736128:0@lo:13:osp-pre-0-1.0 00000001:00080000:0.0:1788869713.820815:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:0.0:1788869713.820829:0:6463:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788869713.820866:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788869713.820878:0:6516:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1788869713.823836:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869713.823930:0:13961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554736000 00000100:00100000:2.0:1788869713.823947:0:13961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554736000 00000100:00100000:2.0:1788869713.824045:0:13961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788869713.824060:0:13961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554736000:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788869713.824067:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788869713.824090:0:13961:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788869713.824575:0:13961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554736000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 517us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869713.824585:0:13961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788869713.825828:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8335d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554736000:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788869713.948307:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869714.330766:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554736256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869714.330837:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869714.330918:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554736256 00000100:00100000:3.0:1788869714.330926:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554736256 00000100:00100000:3.0:1788869714.330972:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788869714.330981:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554736256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869714.331016:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788869714.331065:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554736256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869714.331072:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788869714.331118:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554736256:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788869714.977096:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869715.992610:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788869716.248992:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788869716.376651:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554736512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869716.376749:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869716.376838:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869716.376845:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8335df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554736384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869716.376873:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869716.377065:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554736512 00000100:00100000:0.0:1788869716.377074:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554736512 00000100:00100000:0.0:1788869716.377149:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788869716.377159:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554736512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788869716.377198:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788869716.377248:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554736512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869716.377276:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788869716.377433:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554736512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869716.377799:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554736384 00000100:00100000:1.0:1788869716.377812:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554736384 00000100:00100000:1.0:1788869716.377869:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788869716.377877:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554736384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788869716.377908:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869716.377956:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554736384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869716.377962:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788869716.378182:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8335df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554736384:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788869716.378245:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1788869716.504485:0:13761:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788869716.504495:0:13761:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869716.504599:0:13761:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788869716.504606:0:13761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788869716.888899:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554736896:0@lo:400:kworker.0 00000100:00100000:1.0:1788869716.888970:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869716.889023:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554737408:0@lo:400:kworker.0 00000100:00100000:1.0:1788869716.889051:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869716.889068:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554737920:0@lo:400:kworker.0 00000100:00100000:2.0:1788869716.889303:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554736768:0@lo:400:kworker.0 00000100:00100000:2.0:1788869716.889335:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869716.889355:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554737280:0@lo:400:kworker.0 00000100:00100000:2.0:1788869716.889375:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869716.889391:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554737792:0@lo:400:kworker.0 00000100:00100000:2.0:1788869716.889408:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869716.889430:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788869716.889435:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554736640:0@lo:400:kworker.0 00000100:00100000:2.0:1788869716.889463:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869716.889526:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554737152:0@lo:400:kworker.0 00000100:00100000:2.0:1788869716.889549:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869716.889567:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875765554737664:0@lo:400:kworker.0 00000100:00100000:2.0:1788869716.889593:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869716.889616:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554736896 00000100:00100000:3.0:1788869716.889625:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554736768 00000100:00100000:3.0:1788869716.889632:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554736768 00000100:00100000:2.0:1788869716.889632:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554736896 00000100:00100000:3.0:1788869716.889667:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554737280 00000100:00100000:3.0:1788869716.889670:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554737280 00000100:00100000:1.0:1788869716.889755:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869716.889778:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788869716.889784:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554737024:0@lo:400:kworker.0 00000100:00100000:1.0:1788869716.889810:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869716.889829:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554737536:0@lo:400:kworker.0 00000100:00100000:1.0:1788869716.889848:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869716.889872:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554737792 00000100:00100000:1.0:1788869716.889876:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554737792 00000100:00100000:0.0:1788869716.891189:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554737152 00000100:00100000:0.0:1788869716.891196:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554737152 00000100:00100000:2.0:1788869716.891502:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554737664 00000100:00100000:2.0:1788869716.891506:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554737664 00000100:00100000:2.0:1788869716.895323:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788869716.895337:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554736768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869716.895453:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554736768:12345-0@lo:400:kworker.0 Request processed in 117us (6116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869716.895461:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788869716.896175:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788869716.896189:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554736896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869716.896234:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554736896:12345-0@lo:400:kworker.0 Request processed in 50us (7264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869716.896240:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788869716.896280:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788869716.896288:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875765554737664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869716.896317:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875765554737664:12345-0@lo:400:kworker.0 Request processed in 31us (6723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869716.896324:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788869716.896353:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554736640 00000100:00100000:2.0:1788869716.896360:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554736640 00000100:00100000:2.0:1788869716.896404:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1788869716.896412:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3619:x1875765554736640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869716.896444:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3619:x1875765554736640:12345-0@lo:400:kworker.0 Request processed in 34us (6981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869716.896450:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1788869716.896496:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554737408 00000100:00100000:2.0:1788869716.896500:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554737408 00000100:00100000:3.0:1788869716.897410:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1788869716.897422:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875765554737280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869716.897501:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875765554737280:12345-0@lo:400:kworker.0 Request processed in 83us (8124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869716.897506:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1788869716.897531:0:14581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554737920 00000100:00100000:3.0:1788869716.897536:0:14581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554737920 00000100:00100000:3.0:1788869716.897567:0:14581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554737536 00000100:00100000:3.0:1788869716.897579:0:14581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554737536 00000100:00100000:1.0:1788869716.897654:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788869716.897663:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875765554737792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869716.897699:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875765554737792:12345-0@lo:400:kworker.0 Request processed in 37us (8289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869716.897705:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788869716.897725:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554737024 00000100:00100000:2.0:1788869716.898914:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788869716.898925:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554737920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869716.898987:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554737920:12345-0@lo:400:kworker.0 Request processed in 65us (9230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869716.898993:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788869716.899008:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788869716.899063:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554737024 00000100:00100000:1.0:1788869716.899110:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788869716.899117:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554737024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869716.899154:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554737024:12345-0@lo:400:kworker.0 Request processed in 39us (9343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869716.899160:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788869716.899224:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554737024:0@lo:400:kworker.0 00000100:00100000:1.0:1788869716.899239:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554736896:0@lo:400:kworker.0 00000100:00100000:1.0:1788869716.899264:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554737920:0@lo:400:kworker.0 00000100:00100000:1.0:1788869716.899283:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869716.899298:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8335e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554738048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869716.899334:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869716.899370:0:13961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554738048 00000100:00100000:1.0:1788869716.899374:0:13961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554738048 00000100:00100000:1.0:1788869716.899398:0:13961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788869716.899404:0:13961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554738048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788869716.899421:0:13961:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788869716.899454:0:13961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554738048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869716.899461:0:13961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788869716.899503:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8335e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554738048:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788869716.899562:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869716.901169:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1788869716.902056:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554737152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869716.902152:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554737152:12345-0@lo:400:kworker.0 Request processed in 107us (12600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869716.902162:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1788869716.902308:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554736640:0@lo:400:kworker.0 00000100:00100000:0.0:1788869716.902324:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554737152:0@lo:400:kworker.0 00000100:00100000:0.0:1788869716.902338:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875765554737664:0@lo:400:kworker.0 00000100:00100000:0.0:1788869716.902350:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554736768:0@lo:400:kworker.0 00010000:00080000:0.0:1788869716.902365:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfb1d500 x1875765554737280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869716.902374:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554737280:0@lo:400:kworker.0 00010000:00080000:0.0:1788869716.902386:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfb1f100 x1875765554737792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869716.902394:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554737792:0@lo:400:kworker.0 00000100:00100000:3.0:1788869716.905627:0:14581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788869716.905641:0:14581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554737536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869716.905758:0:14581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554737536:12345-0@lo:400:kworker.0 Request processed in 119us (15907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869716.905766:0:14581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788869716.906164:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554737536:0@lo:400:kworker.0 00000100:00100000:2.0:1788869716.910437:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554737408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869716.910586:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554737408:12345-0@lo:400:kworker.0 Request processed in 11571us (21534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869716.910597:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788869716.911222:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554737408:0@lo:400:kworker.0 00000100:00080000:1.0:1788869716.912798:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869716.912805:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869716.912808:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788869717.018387:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869717.441298:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869717.441439:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545254272 00000100:00100000:2.0:1788869717.441449:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545254272 00000100:00100000:2.0:1788869717.441541:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:2.0:1788869717.441552:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+18:13176:x1875765545254272:12345-192.168.201.30@tcp:35:umount.0 00000100:00100000:2.0:1788869717.441803:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+19:13176:x1875765545254272:12345-192.168.201.30@tcp:35:umount.0 Request processed in 253us (563us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788869717.441810:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00080000:0.0:1788869717.442014:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869717.446716:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869717.446790:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545254528 00000100:00100000:2.0:1788869717.446799:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545254528 00000100:00100000:2.0:1788869717.446846:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:2.0:1788869717.446856:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+19:13176:x1875765545254528:12345-192.168.201.30@tcp:35:umount.0 00000100:00100000:2.0:1788869717.447161:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+20:13176:x1875765545254528:12345-192.168.201.30@tcp:35:umount.0 Request processed in 306us (451us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788869717.447170:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:0.0:1788869717.453436:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869717.453618:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545254784 00000100:00100000:2.0:1788869717.453628:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545254784 00000100:00100000:2.0:1788869717.453677:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:2.0:1788869717.453685:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff87cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+20:13176:x1875765545254784:12345-192.168.201.30@tcp:35:umount.0 00000100:00100000:2.0:1788869717.453964:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff87cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+21:13176:x1875765545254784:12345-192.168.201.30@tcp:35:umount.0 Request processed in 279us (539us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788869717.453972:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:0.0:1788869717.474200:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869717.474311:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545255040 00000100:00100000:2.0:1788869717.474321:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545255040 00000100:00100000:2.0:1788869717.474382:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:2.0:1788869717.474392:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+21:13176:x1875765545255040:12345-192.168.201.30@tcp:35:umount.0 00000100:00100000:2.0:1788869717.474719:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bf4fff62-1855-4361-a244-1a23eb291d37+22:13176:x1875765545255040:12345-192.168.201.30@tcp:35:umount.0 Request processed in 327us (527us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788869717.474727:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:0.0:1788869717.482523:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869717.482563:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869717.482593:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869717.482631:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869717.482664:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545255552 00000100:00100000:0.0:1788869717.482673:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545255552 00000100:00100000:0.0:1788869717.482739:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00100000:0.0:1788869717.482749:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2386:x1875765545255552:12345-192.168.201.30@tcp:9:umount.0 00000020:00000080:0.0:1788869717.482779:0:8400:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2fc3 00000100:00080000:0.0:1788869717.482788:0:8400:0:(import.c:65:import_set_state_nolock()) ffff99fe8385f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788869717.482832:0:8400:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788869717.483172:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545255168 00000100:00100000:3.0:1788869717.483177:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545255168 00000100:00100000:3.0:1788869717.483219:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545255296 00000100:00100000:3.0:1788869717.483223:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545255296 00000100:00100000:3.0:1788869717.483241:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545255424 00000100:00100000:3.0:1788869717.483244:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545255424 00000100:00100000:3.0:1788869717.483297:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:3.0:1788869717.483306:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3df077ce-aecd-4e92-8493-7099e13a8f7b+15:2388:x1875765545255168:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869717.483321:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869717.483344:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb95a9800/0xbead52e175fc2ca5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa90b expref: 15 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869717.483361:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869717.483414:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3df077ce-aecd-4e92-8493-7099e13a8f7b+14:2388:x1875765545255168:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 109us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869717.483422:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:3.0:1788869717.483441:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:3.0:1788869717.483447:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3df077ce-aecd-4e92-8493-7099e13a8f7b+13:2388:x1875765545255296:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869717.483469:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869717.483490:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff81534200/0xbead52e175fc2be8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa8cc expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869717.483500:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869717.483520:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:2388:x1875765545255296:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 73us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869717.483526:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:3.0:1788869717.483539:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:3.0:1788869717.483544:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3df077ce-aecd-4e92-8493-7099e13a8f7b+11:2388:x1875765545255424:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869717.483551:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869717.483560:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb9a9ea00/0xbead52e175fc2ec0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9e4 expref: 11 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869717.483570:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869717.483585:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2388:x1875765545255424:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 41us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869717.483591:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00080000:3.0:1788869717.483738:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788869717.483817:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869717.484665:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bf4fff62-1855-4361-a244-1a23eb291d37+2:2386:x1875765545255552:12345-192.168.201.30@tcp:9:umount.0 Request processed in 1913us (2028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869717.484675:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00100000:0.0:1788869717.499002:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869717.499219:0:14581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545255936 00000100:00100000:3.0:1788869717.499229:0:14581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545255936 00000100:00100000:3.0:1788869717.499374:0:14581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 82 00000100:00100000:3.0:1788869717.499384:0:14581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf4fff62-1855-4361-a244-1a23eb291d37+7:2386:x1875765545255936:12345-192.168.201.30@tcp:9:umount.0 00000020:00000080:3.0:1788869717.499414:0:14581:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc3239 00000020:00010000:3.0:1788869717.499420:0:14581:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99fe81cb2800: total 0 00000100:00080000:3.0:1788869717.499425:0:14581:0:(import.c:65:import_set_state_nolock()) ffff99ff8554e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788869717.499489:0:14581:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788869717.499649:0:14581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bf4fff62-1855-4361-a244-1a23eb291d37+5:2386:x1875765545255936:12345-192.168.201.30@tcp:9:umount.0 Request processed in 267us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869717.499657:0:14581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 82 00000020:00010000:1.0:1788869717.501802:0:6473:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99fe81cb2800: total 0 00010000:00010000:1.0:1788869717.501871:0:6473:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99fe81cb2800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788869717.501946:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d7ad86d/0xbead52e175fc3cc0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaadb1 expref: 4 pid: 14581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.501986:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a9ba5c/0xbead52e175fc35f1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabce expref: 3 pid: 8527 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869717.502004:0:6473:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99fe81cb2800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788869717.502016:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869717.502018:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869717.502020:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788869717.503210:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869717.516537:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869717.516631:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545256960 00000100:00100000:1.0:1788869717.516640:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545256960 00000100:00100000:1.0:1788869717.516700:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 258 00000100:00100000:1.0:1788869717.516709:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+22:2386:x1875765545256960:12345-192.168.201.30@tcp:39:umount.0 00000020:00000080:1.0:1788869717.516742:0:12967:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2bfd 00000020:00010000:1.0:1788869717.516758:0:12967:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99fe8337d800: total 0 00000100:00080000:1.0:1788869717.516762:0:12967:0:(import.c:65:import_set_state_nolock()) ffff99fe8337c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788869717.516790:0:12967:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1788869717.516952:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bf4fff62-1855-4361-a244-1a23eb291d37+21:2386:x1875765545256960:12345-192.168.201.30@tcp:39:umount.0 Request processed in 243us (426us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1788869717.516960:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 258 00000020:00010000:2.0:1788869717.517156:0:6472:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99fe8337d800: total 0 00010000:00010000:2.0:1788869717.517204:0:6472:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99fe8337d800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788869717.517237:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:2.0:1788869717.517241:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788869717.517247:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05800/0xbead52e175fc3676 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabf1 expref: 20 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.517303:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99ffb89e0500) 00010000:00010000:2.0:1788869717.517306:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869717.517311:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0e00/0xbead52e175fc2f22 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9f2 expref: 19 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.517346:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:2.0:1788869717.517349:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869717.517353:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9ee00/0xbead52e175fc3c81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad9c expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.517364:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:2.0:1788869717.517366:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788869717.517370:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc34d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaab81 expref: 17 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.517381:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99ffb89e1100) 00010000:00010000:2.0:1788869717.517383:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788869717.517387:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9fc00/0xbead52e175fc3963 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaacca expref: 16 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.517400:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff88bbf700) 00010000:00010000:2.0:1788869717.517402:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788869717.517406:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc365a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabea expref: 15 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.517417:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:2.0:1788869717.517419:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788869717.517423:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc3cab lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaadaa expref: 14 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.517433:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:2.0:1788869717.517435:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788869717.517442:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1000/0xbead52e175fc2f99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaa0e expref: 13 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.517454:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:2.0:1788869717.517456:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869717.517460:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc35b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabb9 expref: 12 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.517472:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99ff88bbfc00) 00010000:00010000:2.0:1788869717.517474:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788869717.517488:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1e00/0xbead52e175fc3ba1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaad64 expref: 11 pid: 9496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.517508:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99fe831e6400) 00010000:00010000:2.0:1788869717.517510:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788869717.517513:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05600/0xbead52e175fc35dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaabc7 expref: 10 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.517525:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99fe831e3300) 00010000:00010000:2.0:1788869717.517528:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788869717.517532:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05a00/0xbead52e175fc3294 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaae7 expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.517544:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99ffb89e0700) 00010000:00010000:2.0:1788869717.517546:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869717.517549:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1600/0xbead52e175fc2f3e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9f9 expref: 8 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869717.517562:0:6472:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99fe8337d800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788869717.517578:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869717.517580:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869717.517581:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869717.527470:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869717.527568:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545257088 00000100:00100000:0.0:1788869717.527578:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545257088 00000100:00080000:3.0:1788869717.527632:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869717.527656:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 259 00000100:00100000:0.0:1788869717.527669:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+5:2386:x1875765545257088:12345-192.168.201.30@tcp:39:umount.0 00000020:00000080:0.0:1788869717.527718:0:6485:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2bf6 00000100:00080000:0.0:1788869717.527737:0:6485:0:(import.c:65:import_set_state_nolock()) ffff99ffbf9b0800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788869717.527775:0:6485:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1788869717.527785:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869717.527956:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bf4fff62-1855-4361-a244-1a23eb291d37+3:2386:x1875765545257088:12345-192.168.201.30@tcp:39:umount.0 Request processed in 289us (507us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788869717.527965:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 259 00010000:00010000:1.0:1788869718.043628:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869718.634411:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869718.634463:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869718.634514:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869718.634548:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545257216 00000100:00100000:0.0:1788869718.634559:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545257216 00000100:00100000:0.0:1788869718.634618:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 396 00000100:00100000:0.0:1788869718.634630:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2388:x1875765545257216:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869718.634699:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2388:x1875765545257216:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 71us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869718.634707:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 396 00000100:00100000:2.0:1788869718.634817:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545257472 00000100:00100000:2.0:1788869718.634822:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545257472 00000100:00100000:2.0:1788869718.634873:0:9496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545257344 00000100:00100000:2.0:1788869718.634877:0:9496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545257344 00000100:00100000:2.0:1788869718.634901:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 367 00000100:00100000:2.0:1788869718.634908:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2388:x1875765545257472:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869718.635028:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2388:x1875765545257472:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 120us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869718.635034:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 367 00000100:00100000:2.0:1788869718.635048:0:9496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 368 00000100:00100000:2.0:1788869718.635055:0:9496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+6:2388:x1875765545257344:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869718.635080:0:9496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85067cd6-7cd1-4166-bc53-2e9768411f07+6:2388:x1875765545257344:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869718.635086:0:9496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 368 00000100:00080000:0.0:1788869718.635161:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869718.635166:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869718.937089:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869718.937118:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8335d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554738176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869718.937196:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869718.937367:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554738176 00000100:00100000:3.0:1788869718.937376:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554738176 00000100:00100000:3.0:1788869718.937449:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788869718.937461:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554738176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869718.937505:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788869718.937568:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554738176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869718.937575:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788869718.937774:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8335d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554738176:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788869718.937839:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869718.937955:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554738304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869718.937995:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869718.938114:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554738304 00000100:00100000:3.0:1788869718.938119:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554738304 00000100:00100000:3.0:1788869718.938163:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788869718.938171:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554738304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869718.938193:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00080000:2.0:1788869718.938275:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869718.940074:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554738304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1897us (2071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869718.940097:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788869718.940142:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554738304:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788869719.066340:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869719.448686:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554738432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869719.448759:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869719.448914:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554738432 00000100:00100000:2.0:1788869719.448922:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554738432 00000100:00100000:2.0:1788869719.448975:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788869719.448985:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554738432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869719.449018:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788869719.451035:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554738432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2043us (2267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869719.451048:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788869719.452635:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554738432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869719.517726:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869719.517768:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869719.517809:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869719.517913:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545257728 00000100:00100000:0.0:1788869719.517923:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545257728 00000100:00100000:0.0:1788869719.518067:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545257600 00000100:00100000:0.0:1788869719.518071:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545257600 00000100:00100000:1.0:1788869719.518460:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545257856 00000100:00100000:1.0:1788869719.518465:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545257856 00000100:00100000:1.0:1788869719.518503:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:1.0:1788869719.518511:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae64f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3df077ce-aecd-4e92-8493-7099e13a8f7b+12:2390:x1875765545257728:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869719.518525:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869719.518542:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc2d00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa951 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.518556:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869719.518596:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae64f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3df077ce-aecd-4e92-8493-7099e13a8f7b+11:2390:x1875765545257728:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 87us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869719.518602:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:1.0:1788869719.518636:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:1.0:1788869719.518640:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3df077ce-aecd-4e92-8493-7099e13a8f7b+10:2390:x1875765545257600:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869719.518645:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869719.518651:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb9a9ec00/0xbead52e175fc2cf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa920 expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.518673:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869719.518685:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3df077ce-aecd-4e92-8493-7099e13a8f7b+9:2390:x1875765545257600:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 45us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869719.518690:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:1.0:1788869719.518698:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:1.0:1788869719.518702:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3df077ce-aecd-4e92-8493-7099e13a8f7b+8:2390:x1875765545257856:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869719.518707:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869719.518713:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb95a9a00/0xbead52e175fc2eb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa9dd expref: 8 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869719.518719:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869719.518727:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3df077ce-aecd-4e92-8493-7099e13a8f7b+7:2390:x1875765545257856:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 25us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869719.518731:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:3.0:1788869719.537777:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869719.540987:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545258112 00000100:00100000:1.0:1788869719.541004:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545258112 00000100:00100000:1.0:1788869719.541085:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 260 00000100:00100000:1.0:1788869719.541097:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+6:2386:x1875765545258112:12345-192.168.201.30@tcp:39:umount.0 00000020:00000080:1.0:1788869719.541141:0:6485:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2d0e 00000020:00010000:1.0:1788869719.541151:0:6485:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99fe833db000: total 0 00000100:00080000:1.0:1788869719.541156:0:6485:0:(import.c:65:import_set_state_nolock()) ffff99fe833d9000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788869719.541194:0:6485:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1788869719.541411:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2386:x1875765545258112:12345-192.168.201.30@tcp:39:umount.0 Request processed in 315us (3647us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1788869719.541428:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 260 00000020:00010000:3.0:1788869719.541860:0:7425:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99fe833db000: total 0 00010000:00010000:3.0:1788869719.541866:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869719.541931:0:7425:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99fe833db000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788869719.541976:0:7425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff88bbf700) 00010000:00010000:3.0:1788869719.541980:0:7425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869719.541988:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb9a9f600/0xbead52e175fc3cce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaadb8 expref: 4 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869719.542017:0:7425:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99fe833db000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788869719.542028:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869719.542030:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869719.542032:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869719.558097:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869719.558208:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545258240 00000100:00100000:2.0:1788869719.558220:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545258240 00000100:00100000:2.0:1788869719.558342:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 261 00000100:00100000:2.0:1788869719.558355:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+5:2386:x1875765545258240:12345-192.168.201.30@tcp:39:umount.0 00000020:00000080:2.0:1788869719.558413:0:6486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2d15 00000100:00080000:2.0:1788869719.558435:0:6486:0:(import.c:65:import_set_state_nolock()) ffff99fe833dc800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788869719.558464:0:6486:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:1.0:1788869719.558500:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869719.558622:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85067cd6-7cd1-4166-bc53-2e9768411f07+3:2386:x1875765545258240:12345-192.168.201.30@tcp:39:umount.0 Request processed in 269us (538us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788869719.558630:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 261 00000100:00100000:0.0:1788869719.587782:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869719.588119:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545258496 00000100:00100000:1.0:1788869719.588131:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545258496 00000100:00100000:1.0:1788869719.588192:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 397 00000100:00100000:1.0:1788869719.588202:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff95450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+7:2386:x1875765545258496:12345-192.168.201.30@tcp:251:umount.0 00000020:00000080:1.0:1788869719.588248:0:6479:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2bd3 00000020:00010000:1.0:1788869719.588307:0:6479:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99fe83378800: total 0 00000100:00080000:1.0:1788869719.588312:0:6479:0:(import.c:65:import_set_state_nolock()) ffff99fe83378000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788869719.588393:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff95450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3df077ce-aecd-4e92-8493-7099e13a8f7b+3:2386:x1875765545258496:12345-192.168.201.30@tcp:251:umount.0 Request processed in 192us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869719.588402:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 397 00000020:00010000:2.0:1788869719.588530:0:6472:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99fe83378800: total 0 00010000:00010000:2.0:1788869719.588587:0:6472:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99fe83378800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788869719.588627:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb98e3c00/0xbead52e175fc2cac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaa912 expref: 2 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869719.588644:0:6472:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99fe83378800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788869719.588655:0:6472:0:(genops.c:906:class_export_put()) final put ffff99fe83378800/3df077ce-aecd-4e92-8493-7099e13a8f7b 00010000:00010000:2.0:1788869719.588679:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869719.588686:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869719.588688:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788869719.589560:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe83378800/3df077ce-aecd-4e92-8493-7099e13a8f7b for MGS 00000020:00000080:1.0:1788869719.589601:0:14945:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99fe83378000 for MGS 00010000:00010000:0.0:1788869720.094705:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869721.112870:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869721.497162:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869721.497200:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554738560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869721.497323:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869721.497412:0:7791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554738560 00000100:00100000:3.0:1788869721.497421:0:7791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554738560 00000100:00100000:3.0:1788869721.497479:0:7791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788869721.497501:0:7791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554738560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869721.497546:0:7791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788869721.497601:0:7791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554738560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869721.497610:0:7791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788869721.497671:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554738560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869721.498463:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869721.498479:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8335e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554738688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869721.498548:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869721.498597:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554738688 00000100:00100000:2.0:1788869721.498602:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554738688 00000100:00100000:2.0:1788869721.498673:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788869721.498680:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554738688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869721.498710:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869721.498754:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554738688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869721.498760:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:2.0:1788869721.498781:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869721.498816:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8335e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554738688:0@lo:13:osp-pre-1-0.0 00000020:01000004:2.0:1788869721.660988:0:15169:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1788869721.682795:0:15169:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788869721.682850:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2c7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c82 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.682865:0:15169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2c7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2c82 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.682889:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2c7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2c82 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.682897:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2c82 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.682952:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788869721.682957:0:15169:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788869721.682981:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788869721.682987:0:15169:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788869721.682992:0:15169:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788869721.683017:0:15169:0:(import.c:65:import_set_state_nolock()) ffff99ffb8924000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788869721.683075:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875765554738816:0@lo:39:umount.0 00000100:00100000:0.0:1788869721.683138:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869721.683233:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554738816 00000100:00100000:1.0:1788869721.683240:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554738816 00000100:00100000:1.0:1788869721.683306:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788869721.683315:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875765554738816:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788869721.683338:0:12967:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc27ea 00000100:00080000:1.0:1788869721.683345:0:12967:0:(import.c:65:import_set_state_nolock()) ffff99ff84bdc000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788869721.683453:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869721.683462:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2c82 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869721.683469:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535800 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1788869721.683474:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2c82 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869721.683491:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xbead52e175fc2c82 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869721.683499:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xbead52e175fc2c82 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869721.683506:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788869721.683508:0:6472:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788869721.683511:0:6472:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788869721.683586:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2c7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2c82 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.683593:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869721.683617:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2c7b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2c82 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.683624:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ff81535800/0xbead52e175fc2c7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2c82 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.683636:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869721.683638:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869721.683640:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869721.683679:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869721.683689:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554738944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869721.683718:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869721.683780:0:9487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554738944 00000100:00100000:3.0:1788869721.683784:0:9487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554738944 00000100:00100000:3.0:1788869721.683822:0:9487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788869721.683829:0:9487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46892796-b77d-4866-a7cc-ce4160dea4be+24:3618:x1875765554738944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788869721.683847:0:9487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869721.683861:0:9487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb95a8000/0xbead52e175fc2c82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbead52e175fc2c7b expref: 24 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.683872:0:9487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869721.683906:0:9487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46892796-b77d-4866-a7cc-ce4160dea4be+23:3618:x1875765554738944:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869721.683913:0:9487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788869721.683977:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554738944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869721.684148:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3615:x1875765554738816:12345-0@lo:39:umount.0 Request processed in 833us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869721.684156:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:1.0:1788869721.684162:0:12967:0:(genops.c:906:class_export_put()) final put ffff99ff84bda000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788869721.684221:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99ff84bda000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788869721.684287:0:14945:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ff84bdc000 for lustre-MDT0000 00010000:00010000:0.0:1788869721.684925:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788869721.685371:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffb8924000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788869721.685428:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875765554738816:0@lo:39:umount.0 00000100:00080000:2.0:1788869721.685471:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788869721.685480:0:15169:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788869721.685493:0:15169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788869721.689755:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f000/0xbead52e175fc2c89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c90 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869721.689772:0:15169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f000/0xbead52e175fc2c89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2c90 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869721.689781:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f000/0xbead52e175fc2c89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2c90 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869721.689789:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f000/0xbead52e175fc2c89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2c90 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869721.689849:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869721.689857:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8600/0xbead52e175fc2b8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2b94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869721.689863:0:15169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8600/0xbead52e175fc2b8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2b94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869721.689870:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8600/0xbead52e175fc2b8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2b94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869721.689876:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8600/0xbead52e175fc2b8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2b94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869721.690116:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788869721.690124:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f000/0xbead52e175fc2c89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2c90 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869721.690151:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9f000 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1788869721.690156:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f000/0xbead52e175fc2c89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2c90 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869721.690165:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f000/0xbead52e175fc2c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xbead52e175fc2c90 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869721.690172:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f000/0xbead52e175fc2c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xbead52e175fc2c90 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869721.690178:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788869721.690181:0:6473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788869721.690220:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f000/0xbead52e175fc2c89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2c90 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869721.690226:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788869721.690395:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554739072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869721.690468:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788869721.690735:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f000/0xbead52e175fc2c89 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2c90 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869721.690744:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f000/0xbead52e175fc2c89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2c90 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869721.690757:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869721.690761:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8600/0xbead52e175fc2b8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2b94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869721.690767:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a8600 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1788869721.690770:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8600/0xbead52e175fc2b8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2b94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869721.690789:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8600/0xbead52e175fc2b8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbead52e175fc2b94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869721.690795:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8600/0xbead52e175fc2b8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbead52e175fc2b94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869721.690800:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788869721.690802:0:6473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1788869721.690817:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8600/0xbead52e175fc2b8d lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2b94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869721.690822:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869721.690828:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8600/0xbead52e175fc2b8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2b94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869721.690836:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869721.690838:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869721.690840:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869721.690994:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554739200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869721.691227:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869721.691284:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788869721.691291:0:15169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8600/0xbead52e175fc2b8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2b94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869721.691311:0:15169:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788869721.691321:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2ef1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2ef8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869721.691328:0:15169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2ef1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2ef8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869721.691336:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2ef1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2ef8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869721.691342:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2ef1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2ef8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869721.691355:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869721.691361:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81490800/0xbead52e175fc2749 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2750 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869721.691367:0:15169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81490800/0xbead52e175fc2749 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2750 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869721.691373:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81490800/0xbead52e175fc2749 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2750 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869721.691379:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff99ff81490800/0xbead52e175fc2749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2750 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869721.691388:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788869721.691391:0:15169:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788869721.691394:0:15169:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788869721.691430:0:15169:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788869721.691434:0:15169:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788869721.691438:0:15169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869721.691443:0:15169:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1788869721.691448:0:15169:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99fe81f30000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788869721.691454:0:15169:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99fe81cb4800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788869721.691459:0:15169:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ffc10cb000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788869721.691464:0:15169:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99ffb95be000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1788869721.691470:0:15169:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff99fe833db000 85067cd6-7cd1-4166-bc53-2e9768411f07 192.168.201.30@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788869721.691475:0:15169:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff99fe8337d800 bf4fff62-1855-4361-a244-1a23eb291d37 192.168.201.30@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:2.0:1788869721.691479:0:15169:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff99ff8b773380) has exports, disconnecting them 00000020:00080000:2.0:1788869721.691493:0:15169:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99fe81f30000), last request at 1788869716 00000020:00000080:2.0:1788869721.691501:0:15169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2afa 00000100:00080000:2.0:1788869721.691517:0:15169:0:(import.c:65:import_set_state_nolock()) ffff99fe81f35000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788869721.691555:0:15169:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99fe81f30000): rc 0 00000020:00000080:2.0:1788869721.691558:0:15169:0:(genops.c:906:class_export_put()) final put ffff99fe81f30000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788869721.691567:0:15169:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99fe81cb4800), last request at 1788869716 00000020:00000080:2.0:1788869721.691570:0:15169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc29d4 00000100:00080000:2.0:1788869721.691574:0:15169:0:(import.c:65:import_set_state_nolock()) ffff99fe81cb1800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788869721.691580:0:15169:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99fe81cb4800): rc 0 00000020:00000080:2.0:1788869721.691582:0:15169:0:(genops.c:906:class_export_put()) final put ffff99fe81cb4800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788869721.691586:0:15169:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ffc10cb000), last request at 1788869485 00000020:00000080:2.0:1788869721.691588:0:15169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc28d1 00000100:00080000:2.0:1788869721.691592:0:15169:0:(import.c:65:import_set_state_nolock()) ffff99ffc10c9000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788869721.691596:0:15169:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ffc10cb000): rc 0 00000020:00000080:2.0:1788869721.691598:0:15169:0:(genops.c:906:class_export_put()) final put ffff99ffc10cb000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788869721.691608:0:15169:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99ffb95be000), last request at 1788869485 00000020:00000080:2.0:1788869721.691612:0:15169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc28a0 00000100:00080000:2.0:1788869721.691615:0:15169:0:(import.c:65:import_set_state_nolock()) ffff99ffc10cf000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788869721.691622:0:15169:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:2.0:1788869721.691699:0:15169:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ffb95be000): rc 0 00000004:00000080:2.0:1788869721.691704:0:15169:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb76cc7f07ae0 00000100:00080000:2.0:1788869721.691721:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788869721.691724:0:15169:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:2.0:1788869721.692591:0:15169:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788869721.692617:0:15169:0:(import.c:65:import_set_state_nolock()) ffff99ffc10d9800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788869721.692950:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554739328:0@lo:39:umount.0 00000100:00100000:3.0:1788869721.693012:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869721.693070:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554739328 00000100:00100000:3.0:1788869721.693078:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554739328 00000100:00100000:3.0:1788869721.693119:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788869721.693127:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875765554739328:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788869721.693155:0:6489:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc292c 00000100:00080000:3.0:1788869721.693162:0:6489:0:(import.c:65:import_set_state_nolock()) ffff99ffb9899800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788869721.693175:0:6489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788869721.693332:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3615:x1875765554739328:12345-0@lo:39:umount.0 Request processed in 205us (319us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788869721.693339:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:3.0:1788869721.693383:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffc10d9800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788869721.693389:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554739328:0@lo:39:umount.0 00010000:00010000:3.0:1788869721.693416:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869721.693423:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2ef1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2ef8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.693432:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fa00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1788869721.693436:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2ef1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2ef8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.693445:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2ef1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xbead52e175fc2ef8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869721.693452:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2ef1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xbead52e175fc2ef8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869721.693458:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788869721.693461:0:6472:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788869721.693464:0:6472:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788869721.693497:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2ef1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2ef8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.693504:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869721.693523:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2ef1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2ef8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.693530:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc2ef1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2ef8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.693542:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869721.693545:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ff81490800/0xbead52e175fc2749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2750 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.693561:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81490800 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1788869721.693564:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ff81490800/0xbead52e175fc2749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2750 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.693571:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ff81490800/0xbead52e175fc2749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbead52e175fc2750 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869721.693577:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ff81490800/0xbead52e175fc2749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbead52e175fc2750 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869721.693582:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788869721.693584:0:6472:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788869721.693586:0:6472:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788869721.693604:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ff81490800/0xbead52e175fc2749 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2750 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.693609:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869721.693616:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ff81490800/0xbead52e175fc2749 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2750 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.693622:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ff81490800/0xbead52e175fc2749 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2750 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.693632:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869721.693633:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869721.693635:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869721.693645:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554739584:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788869721.697410:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788869721.697421:0:15169:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1788869721.697449:0:15169:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00080000:2.0:1788869721.697527:0:15169:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788869721.697559:0:15169:0:(import.c:65:import_set_state_nolock()) ffff99ffbf9b1000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788869721.697574:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788869721.697577:0:15169:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1788869721.697598:0:15169:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00080000:2.0:1788869721.697657:0:15169:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788869721.697668:0:15169:0:(import.c:65:import_set_state_nolock()) ffff99ffb9b2c000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788869721.697697:0:15169:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff99ff8b773380) has no exports 00000100:00100000:3.0:1788869721.700971:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554739712:0@lo:9:umount.0 00000100:00100000:3.0:1788869721.701064:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869721.701098:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554739840:0@lo:9:umount.0 00000100:00100000:3.0:1788869721.701120:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869721.701156:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554739712 00000100:00100000:3.0:1788869721.701164:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554739712 00000100:00100000:3.0:1788869721.701216:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554739840 00000100:00100000:3.0:1788869721.701220:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554739840 00000100:00100000:3.0:1788869721.701243:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788869721.701270:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875765554739712:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788869721.701298:0:8401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2a7c 00000100:00080000:3.0:1788869721.701308:0:8401:0:(import.c:65:import_set_state_nolock()) ffff99fe81ccb000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788869721.701349:0:8401:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788869721.701469:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3615:x1875765554739712:12345-0@lo:9:umount.0 Request processed in 217us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869721.701477:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788869721.701506:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788869721.701513:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875765554739840:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788869721.701524:0:8401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2bbe 00000100:00080000:3.0:1788869721.701533:0:8401:0:(import.c:65:import_set_state_nolock()) ffff99fe81f33800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788869721.701550:0:8401:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788869721.701618:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3615:x1875765554739840:12345-0@lo:9:umount.0 Request processed in 105us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869721.701624:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788869721.701645:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869721.701681:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffbf9b1000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788869721.701692:0:3615:0:(osp_dev.c:1675:osp_import_event()) got disconnected 00000004:00080000:3.0:1788869721.701694:0:3615:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:3.0:1788869721.701697:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554739712:0@lo:9:umount.0 00000100:00080000:3.0:1788869721.701717:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffb9b2c000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788869721.701721:0:3615:0:(osp_dev.c:1675:osp_import_event()) got disconnected 00000004:00080000:3.0:1788869721.701722:0:3615:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:3.0:1788869721.701725:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554739840:0@lo:9:umount.0 00010000:00010000:3.0:1788869721.701751:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869721.703399:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869721.703420:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554739456:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1788869721.703950:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe81f30000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788869721.704007:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe81cb4800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788869721.704027:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffc10cb000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788869721.704049:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99fe81f35000 for lustre-MDT0000 00000020:00000080:1.0:1788869721.704054:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99fe81cb1800 for lustre-MDT0000 00000020:00000080:1.0:1788869721.704058:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ffc10c9000 for lustre-MDT0000 00000100:00100000:1.0:1788869721.704077:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869721.704417:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554739072 00000100:00100000:0.0:1788869721.704427:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554739072 00000100:00100000:0.0:1788869721.704505:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554739200 00000100:00100000:0.0:1788869721.704509:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554739200 00000100:00100000:0.0:1788869721.704536:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869721.704545:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+24:3616:x1875765554739072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869721.704560:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869721.704580:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff81534800/0xbead52e175fc2c90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbead52e175fc2c89 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869721.704597:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869721.704648:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+23:3616:x1875765554739072:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (14180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869721.704656:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869721.704674:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788869721.704680:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+22:3617:x1875765554739200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869721.704688:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869721.704697:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff81534000/0xbead52e175fc2b94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbead52e175fc2b8d expref: 22 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869721.704722:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869721.704751:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+21:3617:x1875765554739200:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (13524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869721.704757:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788869721.704794:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554739072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869721.704821:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554739200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869721.705291:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788869721.705329:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869721.705388:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554739584 00000100:00100000:0.0:1788869721.705398:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554739584 00000100:00100000:0.0:1788869721.705433:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554739456 00000100:00100000:0.0:1788869721.705436:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554739456 00000100:00100000:0.0:1788869721.705456:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788869721.705462:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+22:3619:x1875765554739584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869721.705471:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869721.705480:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff80030400/0xbead52e175fc2750 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbead52e175fc2749 expref: 22 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869721.705502:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869721.705536:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+21:3619:x1875765554739584:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869721.705542:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788869721.705555:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788869721.705561:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae64c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+20:3618:x1875765554739456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869721.705569:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869721.705578:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb98e2600/0xbead52e175fc2ef8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbead52e175fc2ef1 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869721.705587:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869721.705612:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae64c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46892796-b77d-4866-a7cc-ce4160dea4be+19:3618:x1875765554739456:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869721.705619:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788869721.705671:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:46892796-b77d-4866-a7cc-ce4160dea4be:3619:1875765554739584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869721.705862:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554739456:0@lo:103:ldlm_bl.0 00000001:00100000:2.0:1788869721.707828:0:6463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788869721.707839:0:6463:0:(genops.c:906:class_export_put()) final put ffff99ffb95be000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788869721.707866:0:6463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 85067cd6-7cd1-4166-bc53-2e9768411f07 00000001:00080000:2.0:1788869721.707877:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1788869721.707881:0:6463:0:(genops.c:906:class_export_put()) final put ffff99fe833db000/85067cd6-7cd1-4166-bc53-2e9768411f07 00000020:00000080:1.0:1788869721.707893:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffb95be000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000001:00100000:2.0:1788869721.707917:0:6463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bf4fff62-1855-4361-a244-1a23eb291d37 00000001:00080000:2.0:1788869721.707922:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1788869721.707930:0:6463:0:(genops.c:906:class_export_put()) final put ffff99fe8337d800/bf4fff62-1855-4361-a244-1a23eb291d37 00000020:00000080:1.0:1788869721.708233:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe833db000/85067cd6-7cd1-4166-bc53-2e9768411f07 for lustre-MDT0000 00000020:00000080:1.0:1788869721.708320:0:14945:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ffc10cf000 for lustre-MDT0000 00000020:00000080:1.0:1788869721.708325:0:14945:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99fe833d9000 for lustre-MDT0000 00000020:00080000:1.0:1788869721.709070:0:15169:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff99ff8b773380) has no exports 00000020:00000080:0.0:1788869721.712821:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe8337d800/bf4fff62-1855-4361-a244-1a23eb291d37 for lustre-MDT0000 00000020:00000080:0.0:1788869721.712926:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99fe8337c000 for lustre-MDT0000 00000020:00000080:1.0:1788869721.795160:0:15169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc27a4 00000020:00000080:1.0:1788869721.795179:0:15169:0:(genops.c:906:class_export_put()) final put ffff99ffb88cc800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788869721.795309:0:15169:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788869721.795469:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffb88cc800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788869721.795500:0:15169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788869721.795524:0:15169:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788869721.795528:0:15169:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff99ff95688000) has no exports 00000020:00000080:0.0:1788869721.796156:0:15169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc279d 00000020:00000080:0.0:1788869721.796165:0:15169:0:(genops.c:906:class_export_put()) final put ffff99ff899bf000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788869721.796235:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99ff899bf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788869721.809616:0:15169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869721.809635:0:15169:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788869721.809641:0:15169:0:(genops.c:906:class_export_put()) final put ffff99ffac4ad800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788869721.809646:0:15169:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffac4ad800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788869721.809652:0:15169:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1788869721.810372:0:15169:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99fe8302e2a0 - data ffff99fe81846000/ffff99fe832c6c00 00000020:01000000:2.0:1788869721.810534:0:15169:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99ff8739a9c0 - data ffff99ffb3928a20/ffff99ff84bd4400 00000001:00000004:3.0:1788869721.830444:0:15169:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:2.0:1788869721.879965:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788869721.879974:0:15169:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788869721.879990:0:15169:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99fe84026d80 x1875765554739328/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788869731 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869721.880023:0:15169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788869721.886579:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788869721.886586:0:15169:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1788869721.886611:0:15169:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:2.0:1788869721.886614:0:15169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788869721.887190:0:8522:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788869721.887196:0:8522:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788869721.887207:0:8522:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788869721.887709:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788869721.887714:0:15169:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1788869721.887732:0:15169:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:2.0:1788869721.887734:0:15169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788869721.892558:0:9954:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788869721.892568:0:9954:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1788869721.892588:0:9954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788869721.895530:0:15169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc276c 00000020:00000080:2.0:1788869721.895543:0:15169:0:(genops.c:906:class_export_put()) final put ffff99ffac4f8000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788869721.895669:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffac4f8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788869721.902819:0:15169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2781 00000020:00000080:2.0:1788869721.902839:0:15169:0:(genops.c:906:class_export_put()) final put ffff99ffac4f9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788869721.902865:0:15169:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788869721.902871:0:15169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869721.902882:0:15169:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788869721.902898:0:15169:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff99ff8b7719c0) has no exports 00000004:01000000:2.0:1788869721.903152:0:15169:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788869721.903172:0:15169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2bb7 00000020:00000080:2.0:1788869721.903178:0:15169:0:(genops.c:906:class_export_put()) final put ffff99fe83097800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788869721.903183:0:15169:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788869721.903187:0:15169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869721.903199:0:15169:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788869721.903202:0:15169:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff99ffb981b380) has no exports 00000020:00000080:2.0:1788869721.903211:0:15169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2bb0 00000020:00000080:0.0:1788869721.903214:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffac4f9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788869721.903217:0:15169:0:(genops.c:906:class_export_put()) final put ffff99ffb9b2f000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788869721.903818:0:15169:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788869721.903824:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788869721.903831:0:15169:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:2.0:1788869721.903838:0:15169:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:2.0:1788869721.903842:0:15169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788869721.903960:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe83097800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788869721.903970:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffb9b2f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788869721.912311:0:15169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869721.912334:0:15169:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788869721.912343:0:15169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2a75 00000020:00000080:2.0:1788869721.912352:0:15169:0:(genops.c:906:class_export_put()) final put ffff99fe81cca000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788869721.916753:0:14945:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ffb9b2c000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788869721.916773:0:14945:0:(genops.c:906:class_export_put()) final put ffff99ffb9b29800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788869721.916777:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffb9b29800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788869721.916831:0:14945:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788869721.917753:0:15169:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788869721.917778:0:15169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869721.917804:0:15169:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788869721.917809:0:15169:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff99ffbf90cd40) has no exports 00000020:00000080:2.0:1788869721.917817:0:15169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2a6e 00000020:00000080:2.0:1788869721.917824:0:15169:0:(genops.c:906:class_export_put()) final put ffff99ffbf9b3000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788869721.923404:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe81cca000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:2.0:1788869721.923985:0:15169:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788869721.923990:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788869721.923993:0:15169:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:2.0:1788869721.923999:0:15169:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:2.0:1788869721.924002:0:15169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788869721.930957:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffbf9b3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788869721.931420:0:15169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869721.931437:0:15169:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1788869721.931465:0:15169:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788869721.931474:0:15169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2925 00000020:00000080:2.0:1788869721.931482:0:15169:0:(genops.c:906:class_export_put()) final put ffff99ffc10ce800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788869721.931498:0:15169:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1788869721.931503:0:15169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869721.931509:0:15169:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788869721.931513:0:15169:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff99ff955119c0) has no exports 00000020:00000080:2.0:1788869721.931520:0:15169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc291e 00000020:00000080:2.0:1788869721.931524:0:15169:0:(genops.c:906:class_export_put()) final put ffff99ffc10da800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788869721.933076:0:14945:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ffbf9b1000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788869721.933093:0:14945:0:(genops.c:906:class_export_put()) final put ffff99fe81cc9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788869721.933096:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe81cc9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788869721.933109:0:14945:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788869721.933201:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffc10ce800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788869721.933206:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffc10da800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788869721.959323:0:15169:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788869721.959332:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788869721.959337:0:15169:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788869721.959346:0:15169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788869721.959414:0:15169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788869721.959427:0:14945:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ffc10d9800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788869721.959429:0:15169:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788869721.959442:0:14945:0:(genops.c:906:class_export_put()) final put ffff99ffc10da000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788869721.959447:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffc10da000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788869721.959462:0:14945:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788869721.959464:0:15169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788869721.959468:0:15169:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788869721.959472:0:15169:0:(genops.c:906:class_export_put()) final put ffff99ffac4fb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788869721.959475:0:15169:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffac4fb800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788869721.959496:0:15169:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788869721.959604:0:15169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2788 00000020:00000080:0.0:1788869721.959619:0:15169:0:(genops.c:906:class_export_put()) final put ffff99ffac4fb000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788869721.959633:0:15169:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788869721.959637:0:15169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788869721.959642:0:15169:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788869721.959646:0:15169:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff99ff8b774d40) has no exports 00000020:00000080:0.0:1788869721.959667:0:15169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788869721.959670:0:15169:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788869721.959674:0:15169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc278f 00000020:00000080:0.0:1788869721.959678:0:15169:0:(genops.c:906:class_export_put()) final put ffff99ffac4fa000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788869721.959686:0:15169:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ff8b15e800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788869721.959689:0:15169:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ff8b15e800 3 00000020:01000004:0.0:1788869721.959692:0:15169:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ff8b15e800 from lustre-MDT0000 00000020:00000080:0.0:1788869721.959837:0:15169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788869721.959842:0:15169:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788869721.959845:0:15169:0:(genops.c:906:class_export_put()) final put ffff99ffac4fd800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788869721.959847:0:15169:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffac4fd800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788869721.959855:0:15169:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788869721.959886:0:15169:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788869721.959890:0:15169:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788869721.959893:0:15169:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788869721.959895:0:15169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788869721.959898:0:15169:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788869721.959904:0:15169:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99ff8b15b000 46892796-b77d-4866-a7cc-ce4160dea4be 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788869721.959910:0:15169:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff99ff9568cd40) has exports, disconnecting them 00000020:00080000:0.0:1788869721.959914:0:15169:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99ff8b15b000), last request at 1788869475 00000020:00000080:0.0:1788869721.959927:0:15169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2726 00000020:00010000:0.0:1788869721.959931:0:15169:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99ff8b15b000: total 2 00000100:00080000:0.0:1788869721.959934:0:15169:0:(import.c:65:import_set_state_nolock()) ffff99ff8b15e000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788869721.959952:0:15169:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ff8b15b000): rc 0 00000020:00080000:0.0:1788869721.959955:0:15169:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff99ff9568cd40) has no exports 00000100:00100000:0.0:1788869721.960005:0:6478:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff99ff89ac3200:6478] 1 exiting: rc = 0 00000100:00100000:0.0:1788869721.960097:0:6476:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff99ff858aee00:6476] 0 exiting: rc = 1 00000020:00010000:3.0:1788869721.960194:0:6472:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99ff8b15b000: total 2 00010000:00010000:3.0:1788869721.960229:0:6472:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99ff8b15b000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788869721.960376:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb98e2c00/0xbead52e175fc2c4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbead52e175fc2c43 expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.960395:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb9a9e400/0xbead52e175fc2c58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbead52e175fc2c51 expref: 13 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.960410:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb98e3600/0xbead52e175fc2c74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbead52e175fc2c6d expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.960424:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff81491600/0xbead52e175fc2829 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbead52e175fc2822 expref: 11 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.960443:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb95a8e00/0xbead52e175fc2c66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbead52e175fc2c5f expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869721.960445:0:6479:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff99ff89ac2600:6479] 2 exiting: rc = 0 00010000:00010000:3.0:1788869721.960461:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fe823c0600/0xbead52e175fc2ece lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbead52e175fc2ec7 expref: 9 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.960473:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb95a9c00/0xbead52e175fc2edc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbead52e175fc2ed5 expref: 8 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788869721.960513:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffac4fb000/lustre-MDD0000_UUID for lustre-MDD0000 00010000:00010000:3.0:1788869721.960515:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff80031c00/0xbead52e175fc2837 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbead52e175fc2830 expref: 7 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788869721.960520:0:14945:0:(genops.c:906:class_export_put()) final put ffff99ffac4ff000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788869721.960526:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffac4ff000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788869721.960533:0:14945:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00010000:00010000:3.0:1788869721.960538:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb98e2e00/0xbead52e175fc2b4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbead52e175fc2b47 expref: 6 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.960554:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff81534e00/0xbead52e175fc2c9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbead52e175fc2c97 expref: 5 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.960568:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb95a9200/0xbead52e175fc2c2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbead52e175fc2c27 expref: 4 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.960584:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb9a9f200/0xbead52e175fc2c3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbead52e175fc2c35 expref: 3 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788869721.960587:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffac4fa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788869721.960604:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb95a8a00/0xbead52e175fc2eea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbead52e175fc2ee3 expref: 2 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869721.960616:0:6472:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99ff8b15b000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788869721.960630:0:6472:0:(genops.c:906:class_export_put()) final put ffff99ff8b15b000/46892796-b77d-4866-a7cc-ce4160dea4be 00010000:00010000:3.0:1788869721.960649:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869721.960651:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869721.960653:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788869721.962985:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99ff8b15b000/46892796-b77d-4866-a7cc-ce4160dea4be for MGS 00000020:00000080:1.0:1788869721.963039:0:14945:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ff8b15e000 for MGS 00000100:00100000:0.0:1788869721.963565:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963574:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963580:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963587:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963594:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963601:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963607:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963614:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963620:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963627:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963633:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963640:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963647:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963652:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963658:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963665:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963671:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963678:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963685:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963691:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963697:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963720:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963727:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963733:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963739:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963744:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963751:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963757:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963763:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963768:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963774:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963779:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963785:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963790:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963796:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963813:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963818:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963824:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963830:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963836:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963842:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963849:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963855:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963860:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963866:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963871:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963877:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963882:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963889:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963895:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963902:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963922:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963928:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963933:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963939:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963945:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963950:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963955:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963960:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963966:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963971:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963976:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963982:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869721.963987:0:15169:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788869721.969195:0:15169:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99fe8302eea0 - data ffff99fe81846af8/ffff99fe832c6800 00000020:01000000:0.0:1788869721.969350:0:15169:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99ff8739a1e0 - data ffff99ff8aff8438/ffff99ff8893e800 00000020:00000080:0.0:1788869721.969826:0:15169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2711 00000020:00000080:0.0:1788869721.969835:0:15169:0:(genops.c:906:class_export_put()) final put ffff99ff87c82000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788869721.969857:0:15169:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ff8b15e800 from MGS, refs=2 00000020:01000004:0.0:1788869721.969871:0:15169:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ff8b15e800 2 00000020:01000004:0.0:1788869721.969876:0:15169:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ff8b15e800 from MGS 00000020:00000080:0.0:1788869721.969898:0:15169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788869721.969906:0:15169:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788869721.969910:0:15169:0:(genops.c:906:class_export_put()) final put ffff99ff87c86000/MGS 00000020:00000080:0.0:1788869721.969913:0:15169:0:(genops.c:865:class_export_destroy()) destroying export ffff99ff87c86000/MGS for MGS 00000020:01000000:0.0:1788869721.969921:0:15169:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:1.0:1788869721.969985:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99ff87c82000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788869721.969994:0:15169:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788869721.969999:0:15169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788869721.970004:0:15169:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788869721.970012:0:15169:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99ffb8927800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788869721.970019:0:15169:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff99ff95510000) has exports, disconnecting them 00000020:00080000:0.0:1788869721.970023:0:15169:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99ffb8927800), last request at 1788869475 00000020:00000080:0.0:1788869721.970028:0:15169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc27dc 00000020:00080000:0.0:1788869721.970038:0:15169:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ffb8927800): rc 0 00000020:00000080:0.0:1788869721.970043:0:15169:0:(genops.c:906:class_export_put()) final put ffff99ffb8927800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788869721.970467:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffb8927800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788869721.971300:0:15169:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788869721.971305:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788869721.971309:0:15169:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788869721.971314:0:15169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788869721.971331:0:14945:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ffb8924000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788869721.971421:0:15169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788869721.971427:0:15169:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788869721.971430:0:15169:0:(genops.c:906:class_export_put()) final put ffff99ffb8926800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788869721.971433:0:15169:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffb8926800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788869721.971438:0:15169:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788869721.971511:0:15169:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ff8b15e800 1 00000020:00000080:1.0:1788869721.971515:0:15169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2703 00000020:00000080:1.0:1788869721.971520:0:15169:0:(genops.c:906:class_export_put()) final put ffff99ff87c87000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788869721.971527:0:15169:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788869721.971533:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99ff87c87000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788869721.971540:0:15169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869721.971544:0:15169:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788869721.971547:0:15169:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff99ff955c8000) has no exports 00000100:00100000:1.0:1788869722.009468:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554740224:0@lo:400:kworker.0 00000100:00100000:1.0:1788869722.009556:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869722.009615:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875765554740736:0@lo:400:kworker.0 00000100:00100000:1.0:1788869722.009638:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869722.009663:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788869722.009683:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554740352:0@lo:400:kworker.0 00000100:00100000:1.0:1788869722.009708:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869722.009725:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554740864:0@lo:400:kworker.0 00000100:00100000:1.0:1788869722.009750:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869722.010306:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554740096:0@lo:400:kworker.0 00000100:00100000:1.0:1788869722.010335:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869722.010354:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1875765554740608:0@lo:400:kworker.0 00000100:00100000:1.0:1788869722.010374:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869722.010390:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788869722.010396:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554739968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869722.010417:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869722.010438:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554740480:0@lo:400:kworker.0 00000100:00100000:1.0:1788869722.010457:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869722.010498:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554740224 00000100:00100000:1.0:1788869722.010505:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554740224 00000100:00100000:1.0:1788869722.010534:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554740736 00000100:00100000:1.0:1788869722.010536:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554740736 00000100:00100000:1.0:1788869722.010562:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788869722.010571:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875765554740736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869722.010622:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875765554740736:12345-0@lo:400:kworker.0 Request processed in 52us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869722.010630:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788869722.010645:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554740352 00000100:00100000:1.0:1788869722.010648:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554740352 00000100:00100000:1.0:1788869722.010661:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554740096 00000100:00100000:1.0:1788869722.010663:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554740096 00000100:00100000:1.0:1788869722.010670:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554740608 00000100:00100000:1.0:1788869722.010681:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554740608 00000100:00100000:1.0:1788869722.010696:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788869722.010701:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554740352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869722.010730:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554740352:12345-0@lo:400:kworker.0 Request processed in 29us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869722.010736:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788869722.010748:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788869722.010752:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3618:x1875765554740224:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788869722.010759:0:12967:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788869722.010782:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3618:x1875765554740224:12345-0@lo:400:kworker.0 Request processed in 29us (1227us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788869722.010788:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788869722.010799:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788869722.010802:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1875765554740096:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788869722.010807:0:12967:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788869722.010833:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1875765554740096:12345-0@lo:400:kworker.0 Request processed in 29us (498us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788869722.010839:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788869722.010851:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788869722.010855:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1875765554740608:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788869722.010859:0:12967:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788869722.010880:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1875765554740608:12345-0@lo:400:kworker.0 Request processed in 23us (505us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788869722.010885:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1788869722.010915:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788869722.010921:0:3617:0:(import.c:65:import_set_state_nolock()) ffff99ffc10c8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788869722.010925:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788869722.012578:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554740864 00000100:00100000:2.0:1788869722.012589:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554740864 00000100:00100000:2.0:1788869722.012638:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554740480 00000100:00100000:2.0:1788869722.012642:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554740480 00000100:00100000:2.0:1788869722.012672:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788869722.012682:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554740864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869722.012694:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554739968 00000100:00100000:3.0:1788869722.012702:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554739968 00000100:00100000:2.0:1788869722.012748:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1875765554740864:12345-0@lo:400:kworker.0 Request processed in 69us (2997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869722.012756:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788869722.012772:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788869722.012781:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554740480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869722.012795:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788869722.012805:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554739968:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869722.012814:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554740480:12345-0@lo:400:kworker.0 Request processed in 34us (2355us total) trans 0 rc 0/0 00002000:00000024:3.0:1788869722.012822:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788869722.012822:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788869722.012866:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554739968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (2448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869722.012883:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:3.0:1788869722.012912:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869722.012916:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869722.012918:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869722.018220:0:3617:0:(import.c:65:import_set_state_nolock()) ffff99ffc10c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788869722.018235:0:3617:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 103 00000100:00080000:1.0:1788869722.018244:0:3617:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99ffc10c8000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1788869722.018325:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffbfb1fb80 x1875765554740992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869722.018356:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554740096:0@lo:400:kworker.0 00000100:00080000:1.0:1788869722.018390:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788869722.018394:0:3617:0:(import.c:65:import_set_state_nolock()) ffff99fe82ef7000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788869722.018398:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788869722.018401:0:3617:0:(import.c:65:import_set_state_nolock()) ffff99fe82ef7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788869722.018404:0:3617:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 145 00000100:00080000:1.0:1788869722.018409:0:3617:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99fe82ef7000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1788869722.018420:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffbfb1d880 x1875765554741120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869722.018431:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1875765554740608:0@lo:400:kworker.0 00000100:00100000:1.0:1788869722.018467:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554739968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869722.018479:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554740480:0@lo:400:kworker.0 00010000:00080000:1.0:1788869722.018528:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83a31500 x1875765554740352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869722.018538:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554740352:0@lo:400:kworker.0 00000100:00100000:1.0:1788869722.018548:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554740864:0@lo:400:kworker.0 00000100:00080000:1.0:1788869722.018572:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788869722.018575:0:3618:0:(import.c:65:import_set_state_nolock()) ffff99fe81f37800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788869722.018578:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788869722.018581:0:3618:0:(import.c:65:import_set_state_nolock()) ffff99fe81f37800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788869722.018583:0:3618:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 119 00000100:00080000:1.0:1788869722.018587:0:3618:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99fe81f37800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1788869722.018598:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffbfb1df80 x1875765554741248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869722.018608:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554740224:0@lo:400:kworker.0 00010000:00080000:1.0:1788869722.018620:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe83a30a80 x1875765554740736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869722.018629:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875765554740736:0@lo:400:kworker.0 00000100:00100000:3.0:1788869722.018777:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875765554740992:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788869722.019442:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869722.019502:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3615:1875765554741120:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788869722.019527:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869722.019551:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1875765554741248:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788869722.019570:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869722.019609:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554740992 00000100:00100000:3.0:1788869722.019617:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554740992 00000100:00100000:3.0:1788869722.019649:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554741120 00000100:00100000:3.0:1788869722.019652:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554741120 00000100:00100000:3.0:1788869722.019664:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554741248 00000100:00100000:3.0:1788869722.019666:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554741248 00000100:00100000:3.0:1788869722.019679:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788869722.019687:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3615:x1875765554740992:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1788869722.019706:0:12967:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788869722.019746:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3615:x1875765554740992:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 58us (305us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788869722.019754:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788869722.019770:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788869722.019774:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3615:x1875765554741120:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1788869722.019784:0:12967:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788869722.019806:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3615:x1875765554741120:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 31us (279us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788869722.019820:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788869722.019833:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788869722.019837:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3615:x1875765554741248:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788869722.019847:0:12967:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788869722.019872:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3615:x1875765554741248:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 33us (301us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788869722.019877:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1788869722.019906:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffc10c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788869722.019910:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788869722.019914:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875765554740992:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1788869722.019921:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99fe82ef7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788869722.019924:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788869722.019927:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3615:1875765554741120:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1788869722.019934:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99fe81f37800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788869722.019937:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788869722.019940:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1875765554741248:0@lo:38:ptlrpcd_00_02.0 00000020:00000080:1.0:1788869722.036997:0:15169:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788869722.037013:0:15169:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788869722.037019:0:15169:0:(genops.c:906:class_export_put()) final put ffff99ff8b15f000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788869722.037024:0:15169:0:(genops.c:865:class_export_destroy()) destroying export ffff99ff8b15f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788869722.037030:0:15169:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788869722.037178:0:15169:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99ff8b158800 00000020:02000400:1.0:1788869722.037553:0:15169:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788869722.219902:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788869723.051783:0:9476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788869723.051792:0:9476:0:(genops.c:906:class_export_put()) final put ffff99fe81f37000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788869723.051813:0:9476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bf4fff62-1855-4361-a244-1a23eb291d37 00000020:00000080:0.0:1788869723.051815:0:9476:0:(genops.c:906:class_export_put()) final put ffff99fe8385d800/bf4fff62-1855-4361-a244-1a23eb291d37 00000001:00100000:0.0:1788869723.051847:0:8393:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788869723.051852:0:8393:0:(genops.c:906:class_export_put()) final put ffff99fe81ccf800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788869723.051859:0:8393:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bf4fff62-1855-4361-a244-1a23eb291d37 00000020:00000080:0.0:1788869723.051861:0:8393:0:(genops.c:906:class_export_put()) final put ffff99fe81cb2800/bf4fff62-1855-4361-a244-1a23eb291d37 00000020:00000080:0.0:1788869723.051873:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe81f37000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788869723.051916:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe8385d800/bf4fff62-1855-4361-a244-1a23eb291d37 for lustre-OST0001 00000020:00000080:0.0:1788869723.051937:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe81ccf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788869723.051953:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe81cb2800/bf4fff62-1855-4361-a244-1a23eb291d37 for lustre-OST0000 00000020:00000080:0.0:1788869723.051973:0:14945:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99fe81f33800 for lustre-OST0001 00000020:00000080:0.0:1788869723.051986:0:14945:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99fe8385f000 for lustre-OST0001 00000020:00000080:0.0:1788869723.051990:0:14945:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99fe81ccb000 for lustre-OST0000 00000020:00000080:0.0:1788869723.051993:0:14945:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ff8554e000 for lustre-OST0000 00000001:00100000:3.0:1788869723.055815:0:7415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788869723.055831:0:7415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1788869723.055836:0:7415:0:(genops.c:906:class_export_put()) final put ffff99ffb9898000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788869723.055859:0:7415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 85067cd6-7cd1-4166-bc53-2e9768411f07 00000001:00080000:3.0:1788869723.055863:0:7415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1788869723.055865:0:7415:0:(genops.c:906:class_export_put()) final put ffff99fe833de800/85067cd6-7cd1-4166-bc53-2e9768411f07 00000001:00100000:3.0:1788869723.055879:0:7415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bf4fff62-1855-4361-a244-1a23eb291d37 00000001:00080000:3.0:1788869723.055885:0:7415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1788869723.055893:0:7415:0:(genops.c:906:class_export_put()) final put ffff99ffbf9b5000/bf4fff62-1855-4361-a244-1a23eb291d37 00000020:00000080:0.0:1788869723.055933:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffb9898000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788869723.055986:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe833de800/85067cd6-7cd1-4166-bc53-2e9768411f07 for lustre-MDT0001 00000020:00000080:0.0:1788869723.056015:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffbf9b5000/bf4fff62-1855-4361-a244-1a23eb291d37 for lustre-MDT0001 00000020:00000080:0.0:1788869723.056037:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ffb9899800 for lustre-MDT0001 00000020:00000080:0.0:1788869723.056041:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99fe833dc800 for lustre-MDT0001 00000020:00000080:0.0:1788869723.056045:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ffbf9b0800 for lustre-MDT0001 00010000:00010000:2.0:1788869723.248619:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869724.056506:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554741376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869724.056578:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869724.056685:0:13961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554741376 00000100:00100000:1.0:1788869724.056693:0:13961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554741376 00000100:00100000:1.0:1788869724.056757:0:13961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788869724.056765:0:13961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554741376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869724.056795:0:13961:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788869724.056839:0:13961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554741376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869724.056853:0:13961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788869724.056902:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554741376:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788869724.056956:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788869724.248436:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869725.276451:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788869725.879088:0:15370:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1788869725.900837:0:15370:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788869725.900901:0:15370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2000/0xbead52e175fc2c5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869725.900916:0:15370:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2000/0xbead52e175fc2c5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2c66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869725.900940:0:15370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2000/0xbead52e175fc2c5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2c66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869725.900948:0:15370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2000/0xbead52e175fc2c5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2c66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869725.900982:0:15370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788869725.900989:0:15370:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788869725.901021:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788869725.901025:0:15370:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788869725.901031:0:15370:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788869725.901037:0:15370:0:(import.c:65:import_set_state_nolock()) ffff99ffc10c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788869725.901042:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788869725.901044:0:15370:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788869725.901047:0:15370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788869725.901791:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869725.901802:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2000/0xbead52e175fc2c5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2c66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869725.901812:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb98e2000 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1788869725.901817:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2000/0xbead52e175fc2c5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2c66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869725.901825:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2000/0xbead52e175fc2c5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xbead52e175fc2c66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869725.901832:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2000/0xbead52e175fc2c5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xbead52e175fc2c66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869725.901839:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788869725.901842:0:6473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788869725.901845:0:6473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788869725.901886:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2000/0xbead52e175fc2c5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2c66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869725.901892:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869725.901919:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2000/0xbead52e175fc2c5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2c66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869725.901926:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2000/0xbead52e175fc2c5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2c66 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869725.901940:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869725.901951:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869725.901953:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869725.901963:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869725.901985:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554741504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869725.902053:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869725.902119:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554741504 00000100:00100000:1.0:1788869725.902126:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554741504 00000100:00100000:1.0:1788869725.902166:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788869725.902174:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3616:x1875765554741504:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788869725.902180:0:6470:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788869725 with bad export cookie 13739729166477829926 00010000:00010000:2.0:1788869725.907355:0:15370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9e00/0xbead52e175fc2c6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c74 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869725.907378:0:15370:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9e00/0xbead52e175fc2c6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2c74 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869725.907386:0:15370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9e00/0xbead52e175fc2c6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2c74 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869725.907394:0:15370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9e00/0xbead52e175fc2c6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2c74 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869725.907417:0:15370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869725.907440:0:15370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc2b47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2b4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869725.907448:0:15370:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc2b47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2b4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869725.907455:0:15370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc2b47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2b4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869725.907461:0:15370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc2b47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2b4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869725.907475:0:15370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788869725.907482:0:15370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2ee3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2eea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869725.907489:0:15370:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2ee3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2eea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869725.907509:0:15370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2ee3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2eea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869725.907516:0:15370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2ee3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2eea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869725.907539:0:15370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788869725.907545:0:15370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81490e00/0xbead52e175fc2830 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2837 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869725.907552:0:15370:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81490e00/0xbead52e175fc2830 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2837 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869725.907565:0:15370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81490e00/0xbead52e175fc2830 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2837 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869725.907572:0:15370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff99ff81490e00/0xbead52e175fc2830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2837 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869725.907580:0:15370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788869725.907584:0:15370:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1788869725.907611:0:15370:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788869725.907616:0:15370:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788869725.907620:0:15370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869725.907626:0:15370:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788869725.907634:0:15370:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff99fe83091800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788869725.907640:0:15370:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff99fe81cb2000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788869725.907645:0:15370:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff99ff9568b380) has exports, disconnecting them 00000020:00080000:2.0:1788869725.907649:0:15370:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff99fe83091800), last request at 1788869722 00000020:00000080:2.0:1788869725.907657:0:15370:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2b0f 00000100:00080000:2.0:1788869725.910763:0:15370:0:(import.c:65:import_set_state_nolock()) ffff99fe83092800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788869725.910840:0:15370:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99fe83091800): rc 0 00000020:00000080:2.0:1788869725.910844:0:15370:0:(genops.c:906:class_export_put()) final put ffff99fe83091800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788869725.910864:0:15370:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff99fe81cb2000), last request at 1788869722 00000020:00000080:2.0:1788869725.910871:0:15370:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc29e9 00000100:00080000:2.0:1788869725.910882:0:15370:0:(import.c:65:import_set_state_nolock()) ffff99fe81cb7800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788869725.910894:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe83091800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1788869725.910943:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99fe83092800 for lustre-MDT0001 00000020:00080000:2.0:1788869725.910961:0:15370:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99fe81cb2000): rc 0 00000020:00000080:2.0:1788869725.910964:0:15370:0:(genops.c:906:class_export_put()) final put ffff99fe81cb2000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788869725.910991:0:15370:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb76cc14c3ae0 00000020:00000080:2.0:1788869725.911004:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe81cb2000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1788869725.911029:0:14945:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99fe81cb7800 for lustre-MDT0001 00000100:00080000:2.0:1788869725.911051:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788869725.911055:0:15370:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:3.0:1788869725.911855:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788869725.911865:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9e00/0xbead52e175fc2c6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2c74 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869725.911876:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a9e00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1788869725.911880:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9e00/0xbead52e175fc2c6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2c74 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869725.911890:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9e00/0xbead52e175fc2c6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xbead52e175fc2c74 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869725.911896:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9e00/0xbead52e175fc2c6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xbead52e175fc2c74 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869725.911902:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788869725.911904:0:6472:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1788869725.911907:0:6472:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1788869725.911947:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9e00/0xbead52e175fc2c6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2c74 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869725.911954:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869725.911982:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9e00/0xbead52e175fc2c6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2c74 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869725.911990:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9e00/0xbead52e175fc2c6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2c74 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869725.912005:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788869725.912008:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc2b47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2b4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869725.912026:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9e600 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1788869725.912029:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc2b47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2b4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869725.912035:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc2b47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbead52e175fc2b4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869725.912041:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc2b47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbead52e175fc2b4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869725.912045:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788869725.912047:0:6472:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788869725.912049:0:6472:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788869725.912064:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc2b47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2b4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869725.912070:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869725.912077:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc2b47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2b4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869725.912083:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc2b47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2b4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869725.912095:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869725.912098:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2ee3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2eea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869725.912103:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a8c00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1788869725.912106:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2ee3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2eea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869725.912119:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2ee3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbead52e175fc2eea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869725.912125:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2ee3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbead52e175fc2eea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869725.912131:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788869725.912134:0:6472:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788869725.912136:0:6472:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788869725.912151:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2ee3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2eea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869725.912156:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869725.912171:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2ee3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2eea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869725.912176:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8c00/0xbead52e175fc2ee3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2eea expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869725.912185:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869725.912188:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ff81490e00/0xbead52e175fc2830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2837 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869725.912193:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81490e00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1788869725.912196:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ff81490e00/0xbead52e175fc2830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2837 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869725.912202:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ff81490e00/0xbead52e175fc2830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbead52e175fc2837 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869725.912217:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ff81490e00/0xbead52e175fc2830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbead52e175fc2837 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869725.912222:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788869725.912224:0:6472:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788869725.912226:0:6472:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788869725.912238:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ff81490e00/0xbead52e175fc2830 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2837 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869725.912243:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869725.912249:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ff81490e00/0xbead52e175fc2830 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2837 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869725.912271:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ff81490e00/0xbead52e175fc2830 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbead52e175fc2837 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869725.912290:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869725.912291:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869725.912293:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869725.912312:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554741632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869725.912389:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869725.912438:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869725.912443:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554741760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869725.912464:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869725.912503:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554742016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869725.912526:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869725.912544:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869725.912549:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554741888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869725.912580:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869725.912605:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554741632 00000100:00100000:3.0:1788869725.912612:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554741632 00000100:00100000:3.0:1788869725.912640:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554741760 00000100:00100000:3.0:1788869725.912642:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554741760 00000100:00100000:3.0:1788869725.912650:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554742016 00000100:00100000:3.0:1788869725.912652:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554742016 00000100:00100000:3.0:1788869725.912658:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554741888 00000100:00100000:3.0:1788869725.912659:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554741888 00000100:00100000:3.0:1788869725.912671:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788869725.912686:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3618:x1875765554741632:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788869725.912692:0:6469:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788869725 with bad export cookie 13739729166477829926 00000100:00100000:3.0:1788869725.912735:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3618:x1875765554741632:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (344us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788869725.912742:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788869725.912758:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788869725.912762:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84026d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3618:x1875765554741760:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788869725.912767:0:6469:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788869725 with bad export cookie 13739729166477829926 00000100:00100000:3.0:1788869725.912790:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84026d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3618:x1875765554741760:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (326us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788869725.912796:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788869725.912806:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788869725.912810:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3617:x1875765554742016:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788869725.912813:0:6469:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788869725 with bad export cookie 13739729166477829926 00000100:00100000:3.0:1788869725.912839:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3617:x1875765554742016:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (311us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788869725.912844:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788869725.912854:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788869725.912866:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3617:x1875765554741888:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788869725.912871:0:6469:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788869725 with bad export cookie 13739729166477829926 00000100:00100000:3.0:1788869725.912907:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3617:x1875765554741888:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (326us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788869725.912913:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788869725.912948:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788869725.912953:0:3617:0:(import.c:65:import_set_state_nolock()) ffff99ffae58e800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788869725.912956:0:3617:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1788869725.913571:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788869725.913752:0:15370:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788869725.913776:0:15370:0:(import.c:65:import_set_state_nolock()) ffff99ffb95ba000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788869725.913984:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1788869725.914023:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554742144:0@lo:39:umount.0 00000100:00100000:0.0:1788869725.914069:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869725.914111:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554742144 00000100:00100000:0.0:1788869725.914117:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554742144 00000100:00100000:0.0:1788869725.914147:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788869725.914153:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3615:x1875765554742144:12345-0@lo:39:umount.0 00000020:00080000:0.0:1788869725.914160:0:6490:0:(tgt_handler.c:807:tgt_request_handle()) operation 39 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788869725.914191:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3615:x1875765554742144:12345-0@lo:39:umount.0 Request processed in 37us (121us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788869725.914198:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:0.0:1788869725.914222:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffb95ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788869725.914228:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554742144:0@lo:39:umount.0 00010000:00010000:1.0:1788869725.921762:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869725.921958:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3616:x1875765554741504:12345-0@lo:103:ldlm_bl.0 Request processed in 19779us (19900us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788869725.921970:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788869725.922021:0:3616:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788869725.922109:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788869725.922127:0:15370:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1788869725.922142:0:15370:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00080000:0.0:1788869725.922210:0:15370:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788869725.922233:0:15370:0:(import.c:65:import_set_state_nolock()) ffff99fe81cca800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788869725.922249:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788869725.922276:0:15370:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1788869725.922284:0:15370:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:0.0:1788869725.922355:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8335e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554742272:0@lo:9:umount.0 00000100:00100000:0.0:1788869725.922400:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788869725.922448:0:15370:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788869725.922458:0:15370:0:(import.c:65:import_set_state_nolock()) ffff99fe82ef1800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788869725.922474:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554742400:0@lo:9:umount.0 00000100:00100000:0.0:1788869725.922514:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869725.922546:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554742272 00000100:00100000:0.0:1788869725.922552:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554742272 00000100:00100000:0.0:1788869725.922587:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554742400 00000100:00100000:0.0:1788869725.922590:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554742400 00000100:00100000:0.0:1788869725.922618:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788869725.922626:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875765554742272:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788869725.922649:0:8399:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2a36 00000100:00080000:0.0:1788869725.922657:0:8399:0:(import.c:65:import_set_state_nolock()) ffff99fe81f10800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788869725.922691:0:8399:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788869725.922822:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3615:x1875765554742272:12345-0@lo:9:umount.0 Request processed in 196us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869725.922829:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788869725.922842:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788869725.922849:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875765554742400:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788869725.922860:0:8399:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2b78 00000100:00080000:0.0:1788869725.922874:0:8399:0:(import.c:65:import_set_state_nolock()) ffff99fe82ef5800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788869725.922896:0:8399:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788869725.922971:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3615:x1875765554742400:12345-0@lo:9:umount.0 Request processed in 122us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869725.922978:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1788869725.922997:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788869725.923008:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788869725.923030:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99fe82ef1800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788869725.923034:0:3615:0:(osp_dev.c:1675:osp_import_event()) got disconnected 00000004:00080000:0.0:1788869725.923036:0:3615:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:0.0:1788869725.923040:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554742400:0@lo:9:umount.0 00000100:00080000:0.0:1788869725.923049:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99fe81cca800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788869725.923053:0:3615:0:(osp_dev.c:1675:osp_import_event()) got disconnected 00000004:00080000:0.0:1788869725.923054:0:3615:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:0.0:1788869725.923056:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8335e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554742272:0@lo:9:umount.0 00000020:00080000:0.0:1788869725.923097:0:15370:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff99ff9568b380) has no exports 00000100:00080000:3.0:1788869725.933916:0:3617:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.130@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788869725.933922:0:3617:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788869725.933932:0:3617:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ffbfb1f800 x1875765554741504/t0(0) o103->MGC192.168.201.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788869741 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869725.933947:0:3617:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fe8397ca80 x1875765554741632/t0(0) o103->MGC192.168.201.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788869741 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869725.933958:0:3617:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fe8397e300 x1875765554741760/t0(0) o103->MGC192.168.201.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788869741 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869725.933967:0:3617:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fe8397c000 x1875765554742016/t0(0) o103->MGC192.168.201.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788869741 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869725.933976:0:3617:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fe8397ce00 x1875765554741888/t0(0) o103->MGC192.168.201.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788869741 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788869725.933984:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788869725.933987:0:3617:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788869725.933988:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788869725.934181:0:3618:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99ffae58e800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1788869725.934209:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554741632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869725.934238:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:46892796-b77d-4866-a7cc-ce4160dea4be:3618:1875765554741760:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869725.934465:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788869725.934809:0:3616:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99ffae58e800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788869725.934823:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:46892796-b77d-4866-a7cc-ce4160dea4be:3616:1875765554741504:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788869725.935229:0:3617:0:(import.c:65:import_set_state_nolock()) ffff99ffae58e800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869725.935237:0:3617:0:(import.c:510:import_select_connection()) MGC192.168.201.130@tcp: connect to NID 0@lo last attempt 93 00000100:00080000:3.0:1788869725.935244:0:3617:0:(import.c:624:import_select_connection()) MGC192.168.201.130@tcp: import ffff99ffae58e800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788869725.935472:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffae6afb80 x1875765554742528/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869725.935530:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554742016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869725.935549:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:46892796-b77d-4866-a7cc-ce4160dea4be:3617:1875765554741888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869725.935597:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:46892796-b77d-4866-a7cc-ce4160dea4be:3615:1875765554742528:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1788869725.935653:0:3615:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765554742528 offset 0 length 520: 4 00000020:00080000:0.0:1788869725.942869:0:15370:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff99ff9568b380) has no exports 00000020:01000000:0.0:1788869726.022332:0:15370:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99fe81e73c60 - data ffff99fe8185a5e8/ffff99fe832e8400 00000020:01000000:0.0:1788869726.022487:0:15370:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99ff87c52de0 - data ffff99ffb3a13af8/ffff99ffb960b800 00000001:00000004:1.0:1788869726.034419:0:15370:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:1.0:1788869726.087883:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788869726.087892:0:15370:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1788869726.087899:0:15370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788869726.090401:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788869726.090408:0:15370:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1788869726.090424:0:15370:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:2.0:1788869726.090426:0:15370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788869726.092608:0:8514:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788869726.092616:0:8514:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1788869726.092627:0:8514:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788869726.093506:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788869726.093511:0:15370:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1788869726.093522:0:15370:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:2.0:1788869726.093525:0:15370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788869726.093777:0:9950:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788869726.093781:0:9950:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1788869726.093790:0:9950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788869726.094624:0:15370:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2853 00000020:00000080:2.0:1788869726.094635:0:15370:0:(genops.c:906:class_export_put()) final put ffff99ffb8add000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788869726.095706:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffb8add000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788869726.097371:0:15370:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2868 00000020:00000080:2.0:1788869726.097387:0:15370:0:(genops.c:906:class_export_put()) final put ffff99ffc10ff000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788869726.098217:0:15370:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788869726.098235:0:15370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869726.098244:0:15370:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788869726.098249:0:15370:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff99ff956899c0) has no exports 00000004:01000000:2.0:1788869726.098530:0:15370:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788869726.098539:0:15370:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2b71 00000020:00000080:2.0:1788869726.098549:0:15370:0:(genops.c:906:class_export_put()) final put ffff99ffb9b2d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788869726.101302:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffc10ff000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788869726.105271:0:15370:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788869726.105287:0:15370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869726.105309:0:15370:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788869726.105315:0:15370:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff99fe82cd8000) has no exports 00000020:00000080:2.0:1788869726.105325:0:15370:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2b6a 00000020:00000080:2.0:1788869726.105335:0:15370:0:(genops.c:906:class_export_put()) final put ffff99fe82ef2000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788869726.105470:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffb9b2d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:2.0:1788869726.109644:0:15370:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788869726.109653:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788869726.109657:0:15370:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1788869726.109664:0:15370:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:2.0:1788869726.109667:0:15370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788869726.113212:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe82ef2000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788869726.113938:0:15370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869726.113954:0:15370:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788869726.113963:0:15370:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2a2f 00000020:00000080:2.0:1788869726.113972:0:15370:0:(genops.c:906:class_export_put()) final put ffff99ffbbf32000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788869726.119548:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99fe82ef1800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788869726.119567:0:37:0:(genops.c:906:class_export_put()) final put ffff99fe83094800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788869726.119570:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe83094800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788869726.119587:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788869726.120458:0:15370:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788869726.120490:0:15370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869726.120511:0:15370:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788869726.120516:0:15370:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff99ffbf90b380) has no exports 00000020:00000080:2.0:1788869726.120526:0:15370:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2a28 00000020:00000080:2.0:1788869726.120534:0:15370:0:(genops.c:906:class_export_put()) final put ffff99fe81cc9800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788869726.120902:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffbbf32000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788869726.120911:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe81cc9800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788869726.121197:0:15370:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788869726.121202:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788869726.121207:0:15370:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1788869726.121212:0:15370:0:(osp_dev.c:1691:osp_import_event()) got inactive 00000100:00100000:2.0:1788869726.121214:0:15370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788869726.122170:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99fe81cca800 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788869726.122888:0:15370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869726.122906:0:15370:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788869726.122912:0:15370:0:(genops.c:906:class_export_put()) final put ffff99fe81cc8000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788869726.122917:0:15370:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe81cc8000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1788869726.122930:0:15370:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1788869726.123027:0:15370:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788869726.123035:0:15370:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc288b 00000020:00000080:2.0:1788869726.123042:0:15370:0:(genops.c:906:class_export_put()) final put ffff99ffb8ade000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788869726.123057:0:15370:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='') 00000020:00000080:2.0:1788869726.123061:0:15370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869726.123066:0:15370:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788869726.123070:0:15370:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99ffc10f4d40) has no exports 00000020:00000080:2.0:1788869726.123077:0:15370:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2884 00000020:00000080:2.0:1788869726.123080:0:15370:0:(genops.c:906:class_export_put()) final put ffff99ffb95bf800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788869726.124610:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffb8ade000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788869726.124626:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffb95bf800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788869726.126747:0:15370:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1788869726.126756:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788869726.126761:0:15370:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1788869726.126768:0:15370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788869726.126846:0:15370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788869726.126864:0:15370:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788869726.126891:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ffb95ba000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788869726.126903:0:37:0:(genops.c:906:class_export_put()) final put ffff99ffc10fe000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788869726.126905:0:15370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788869726.126907:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffc10fe000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788869726.126910:0:15370:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788869726.126915:0:15370:0:(genops.c:906:class_export_put()) final put ffff99ffb8ad8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788869726.126919:0:15370:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffb8ad8800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788869726.126919:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788869726.126925:0:15370:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788869726.127115:0:15370:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc286f 00000020:00000080:3.0:1788869726.127121:0:15370:0:(genops.c:906:class_export_put()) final put ffff99ffc10f8800/lustre-MDD0001_UUID 00000020:01000000:3.0:1788869726.127131:0:15370:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788869726.127134:0:15370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788869726.127139:0:15370:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788869726.127142:0:15370:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff99ffc10f3380) has no exports 00000020:00000080:3.0:1788869726.127161:0:15370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788869726.127164:0:15370:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1788869726.127167:0:15370:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2876 00000020:00000080:3.0:1788869726.127171:0:15370:0:(genops.c:906:class_export_put()) final put ffff99ffc10f8000/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1788869726.127178:0:15370:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ff89980800 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1788869726.127182:0:15370:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ff89980800 2 00000020:01000004:3.0:1788869726.127185:0:15370:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ff89980800 from lustre-MDT0001 00000020:00000080:3.0:1788869726.127203:0:15370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788869726.127206:0:15370:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1788869726.127209:0:15370:0:(genops.c:906:class_export_put()) final put ffff99ffb8ad9000/lustre-MDT0001_UUID 00000020:00000080:3.0:1788869726.127211:0:15370:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffb8ad9000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1788869726.127218:0:15370:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1788869726.127244:0:15370:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1788869726.127248:0:15370:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1788869726.127267:0:15370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788869726.127271:0:15370:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788869726.127278:0:15370:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff99ffc10ca000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788869726.127283:0:15370:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff99ffb98199c0) has exports, disconnecting them 00000020:00080000:3.0:1788869726.127307:0:15370:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff99ffc10ca000), last request at 1788869485 00000020:00000080:3.0:1788869726.127311:0:15370:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc28ca 00000020:00080000:3.0:1788869726.127324:0:15370:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ffc10ca000): rc 0 00000020:00000080:3.0:1788869726.127329:0:15370:0:(genops.c:906:class_export_put()) final put ffff99ffc10ca000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788869726.127381:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffc10f8800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788869726.127386:0:37:0:(genops.c:906:class_export_put()) final put ffff99ffb8ada000/lustre-MDD0001_UUID 00000020:00000080:1.0:1788869726.127394:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffb8ada000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788869726.127401:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788869726.127611:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffc10f8000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788869726.127619:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffc10ca000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788869726.148772:0:15370:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788869726.148783:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788869726.148788:0:15370:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788869726.148796:0:15370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788869726.148988:0:14945:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ffc10c8000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788869726.149075:0:15370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788869726.149084:0:15370:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788869726.149089:0:15370:0:(genops.c:906:class_export_put()) final put ffff99ffb9721800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788869726.149093:0:15370:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffb9721800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788869726.149099:0:15370:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788869726.149171:0:15370:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ff89980800 1 00000020:00000080:3.0:1788869726.149186:0:15370:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2806 00000020:00000080:3.0:1788869726.149192:0:15370:0:(genops.c:906:class_export_put()) final put ffff99ffb89f4800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788869726.149199:0:15370:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788869726.149202:0:15370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788869726.149208:0:15370:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788869726.149211:0:15370:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff99ff955c99c0) has no exports 00000020:00000080:1.0:1788869726.149386:0:14945:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffb89f4800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788869726.284014:0:15370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788869726.284029:0:15370:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788869726.284035:0:15370:0:(genops.c:906:class_export_put()) final put ffff99ff95523000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788869726.284039:0:15370:0:(genops.c:865:class_export_destroy()) destroying export ffff99ff95523000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788869726.284053:0:15370:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788869726.286247:0:15370:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99ff84bdd000 00000020:01000000:0.0:1788869726.286519:0:15370:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788869726.286577:0:15370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788869726.286583:0:15370:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788869726.286587:0:15370:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff99ff95514d40) has no exports 00000100:00100000:0.0:1788869726.286712:0:6484:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff99ff884bf800:6484] 0 exiting: rc = 1 00000100:00100000:2.0:1788869726.286794:0:12967:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff99ffb97fe000:12967] 4 exiting: rc = 0 00000100:00100000:2.0:1788869726.286922:0:9496:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff99ffb8a88400:9496] 3 exiting: rc = 0 00000100:00100000:2.0:1788869726.286996:0:6486:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff99ff884bf200:6486] 2 exiting: rc = 0 00000100:00100000:0.0:1788869726.287631:0:6485:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff99ff884be000:6485] 1 exiting: rc = 0 00000100:00100000:0.0:1788869726.287703:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.287711:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.287717:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.287724:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.287729:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.287735:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.287740:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288441:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288456:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288463:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288469:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288475:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288481:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288487:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288502:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288518:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288620:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288629:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288635:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288641:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288646:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288653:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288659:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288664:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288670:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288677:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288684:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288689:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288696:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288701:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288707:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288713:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288719:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288725:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288743:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288749:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288756:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288762:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288768:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288774:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288780:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288786:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288791:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288797:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288803:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288809:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288815:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288822:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288829:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288836:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288842:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288848:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288855:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288861:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288867:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288872:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288879:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288885:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288891:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288897:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288902:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288908:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288914:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.288920:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1788869726.297589:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869726.297787:0:6487:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff99ff84c5d800:6487] 0 exiting: rc = 1 00000100:00100000:3.0:1788869726.297939:0:6488:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff99ff8bce9400:6488] 1 exiting: rc = 0 00000100:00100000:0.0:1788869726.298006:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.298016:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.298023:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.298029:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.298051:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.298057:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.298063:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.298070:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.298076:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.298081:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.298089:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301681:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301692:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301697:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301702:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301707:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301711:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301717:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301722:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301728:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301732:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301737:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301743:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301750:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301756:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301762:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301769:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301775:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301781:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301787:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301792:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301798:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301804:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301809:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301814:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301819:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301825:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301830:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301834:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301859:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301881:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301887:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301892:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.301896:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.302022:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.302028:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.302034:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.302039:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.302044:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.302049:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.302054:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.302060:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.302065:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.302070:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.302075:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.302080:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.302085:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.302089:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.302095:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.302100:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.302106:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.302111:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.302117:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.302122:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.302696:0:6490:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff99ffa0073600:6490] 1 exiting: rc = 0 00000100:00100000:3.0:1788869726.302989:0:7791:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff99ffb9884c00:7791] 2 exiting: rc = 0 00000100:00100000:2.0:1788869726.303211:0:6489:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff99ff8bce8e00:6489] 0 exiting: rc = 1 00000100:00100000:0.0:1788869726.303420:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303436:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303447:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303453:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303459:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303467:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303475:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303481:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303487:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303517:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303524:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303532:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303540:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303564:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303573:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303582:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303589:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303596:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303601:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303607:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303615:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303622:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303630:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303637:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303643:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303667:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303675:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303681:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303688:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303694:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303700:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303705:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303712:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303718:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303724:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303730:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303736:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303756:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303763:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303768:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303776:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303783:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303789:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303797:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303809:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303816:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303822:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303829:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303836:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303856:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303875:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303883:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303890:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303898:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303904:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303911:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303917:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303923:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303929:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303935:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303940:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303946:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303953:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.303967:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869726.314144:0:6492:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff99ff8b148000:6492] 1 exiting: rc = 0 00000100:00100000:1.0:1788869726.314332:0:6491:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff99ffa0072000:6491] 0 exiting: rc = 1 00000100:00100000:0.0:1788869726.315396:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315404:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315409:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315414:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315419:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315425:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315430:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315435:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315441:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315446:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315450:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315455:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315460:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315464:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315469:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315502:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315508:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315513:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315518:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315523:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315528:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315533:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315538:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315544:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315548:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315553:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315557:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315562:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315567:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315572:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315577:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315582:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315587:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315593:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315599:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315604:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315609:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315613:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315618:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315624:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315628:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315633:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315638:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315642:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315647:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315652:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315656:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315661:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315667:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315672:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315686:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315691:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315696:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315700:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315705:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315709:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315714:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315718:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315722:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315726:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315731:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315736:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315740:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.315745:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869726.316673:0:6493:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff99ff8b149c00:6493] 0 exiting: rc = 1 00000100:00100000:3.0:1788869726.316801:0:7793:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0002: service thread [ffff99ffb97f0200:7793] 2 exiting: rc = 0 00000100:00100000:1.0:1788869726.316918:0:6494:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff99ff8993c800:6494] 1 exiting: rc = 0 00000100:00100000:2.0:1788869726.316991:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.316999:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317004:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317008:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317014:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317019:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317025:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317030:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317034:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317039:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317045:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317050:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317054:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317059:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317065:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317083:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317089:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317094:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317100:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317105:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317110:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317115:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317120:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317125:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317131:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317203:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317211:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317216:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317222:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317227:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317232:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317238:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317243:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317248:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317549:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317556:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317560:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317566:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317572:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317578:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317582:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317587:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317593:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317598:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317602:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317607:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317612:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317618:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317623:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317628:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317642:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317648:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317653:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317658:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317663:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317669:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317673:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317679:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317683:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317689:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317694:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317699:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317704:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.317709:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869726.318546:0:6496:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff99ff8b149e00:6496] 1 exiting: rc = 0 00000100:00100000:1.0:1788869726.318643:0:6495:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff99ff8b148200:6495] 0 exiting: rc = 1 00000100:00100000:2.0:1788869726.319050:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319057:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319061:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319066:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319071:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319076:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319081:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319085:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319090:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319095:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319101:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319106:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319113:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319117:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319122:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319127:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319132:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319774:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319780:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319786:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319790:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319809:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319814:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319820:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319825:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319830:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319835:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319841:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319847:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319852:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319858:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319864:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319868:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319872:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319878:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319883:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319888:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319893:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319899:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319904:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319910:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319915:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319920:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319925:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319930:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319935:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319940:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319945:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319950:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319955:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319960:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319965:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319971:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319976:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319980:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319985:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.319998:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.320003:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.320008:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.320013:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.320019:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.320024:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.320029:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869726.320034:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.320970:0:6498:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff99ff86aeda00:6498] 1 exiting: rc = 0 00000100:00100000:1.0:1788869726.329335:0:6499:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff99ff89adcc00:6499] 2 exiting: rc = 0 00000100:00100000:2.0:1788869726.330806:0:6497:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff99ff8b148600:6497] 0 exiting: rc = 1 00000100:00100000:3.0:1788869726.331751:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331758:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331763:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331768:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331774:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331779:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331801:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331823:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331830:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331836:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331842:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331848:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331854:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331860:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331865:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331871:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331877:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331882:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331888:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331894:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331901:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331908:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331915:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331921:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331926:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.331932:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332109:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332118:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332124:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332131:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332147:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332167:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332174:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332179:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332185:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332191:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332197:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332203:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332210:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332215:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332221:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332234:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332240:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332245:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332276:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332285:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332290:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332297:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332304:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332309:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332314:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332319:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332324:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332330:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332336:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332356:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332363:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332369:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332374:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332380:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332386:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332392:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332398:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869726.332404:0:15370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788869726.336800:0:15370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788869726.336815:0:15370:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788869726.336822:0:15370:0:(genops.c:906:class_export_put()) final put ffff99ff95527000/MDS_uuid 00000020:00000080:3.0:1788869726.336827:0:15370:0:(genops.c:865:class_export_destroy()) destroying export ffff99ff95527000/MDS_uuid for MDS 00000020:01000000:3.0:1788869726.336833:0:15370:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788869726.336978:0:15370:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00000100:00080000:0.0:1788869727.130533:0:14945:0:(pinger.c:229:ptlrpc_pinger_process_import()) 46892796-b77d-4866-a7cc-ce4160dea4be->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788869727.130544:0:14945:0:(pinger.c:247:ptlrpc_pinger_process_import()) 46892796-b77d-4866-a7cc-ce4160dea4be->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869727.130548:0:14945:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788869727.130552:0:14945:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788869727.130556:0:14945:0:(import.c:65:import_set_state_nolock()) ffff99fe81f37800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869727.130565:0:14945:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 339 00000100:00080000:0.0:1788869727.130571:0:14945:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788869727.130579:0:14945:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99fe81f37800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788869727.130618:0:14945:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe839bca80 x1875765554742656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869727.130659:0:14945:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788869727.130662:0:14945:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788869727.130664:0:14945:0:(import.c:65:import_set_state_nolock()) ffff99fe82ef7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869727.130668:0:14945:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 339 00000100:00080000:0.0:1788869727.130677:0:14945:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788869727.130681:0:14945:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99fe82ef7000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788869727.130694:0:14945:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe839bf480 x1875765554742912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788869727.130749:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554743040:0@lo:400:kworker.0 00000400:00000100:0.0:1788869727.130802:0:3619:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765554743040 offset 0 length 224: 4 00000100:00100000:0.0:1788869727.130856:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869727.130862:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554742784:0@lo:400:kworker.0 00000400:00000100:0.0:1788869727.130881:0:3619:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765554742784 offset 0 length 224: 4 00000100:00100000:2.0:1788869727.131231:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1875765554742656:0@lo:38:kworker.0 00000400:00000100:2.0:1788869727.131282:0:3615:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765554742656 offset 0 length 520: 4 00000100:00100000:2.0:1788869727.131314:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3615:1875765554742912:0@lo:38:kworker.0 00000400:00000100:2.0:1788869727.131332:0:3615:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765554742912 offset 0 length 520: 4 00010000:00010000:1.0:1788869727.321018:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869728.345132:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869729.369385:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788869729.904223:0:15571:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1788869729.923704:0:15571:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788869729.923762:0:15571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9600/0xbead52e175fc2c43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869729.923777:0:15571:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9600/0xbead52e175fc2c43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2c4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869729.923801:0:15571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9600/0xbead52e175fc2c43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2c4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869729.923809:0:15571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9600/0xbead52e175fc2c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2c4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869729.923833:0:15571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788869729.923838:0:15571:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788869729.923862:0:15571:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788869729.923874:0:15571:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fe839bca80 x1875765554742656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788869742 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869729.923895:0:15571:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788869729.923900:0:15571:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788869729.923906:0:15571:0:(import.c:65:import_set_state_nolock()) ffff99fe81f37800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788869729.923910:0:15571:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788869729.923914:0:15571:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fe839bca80 x1875765554742656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788869742 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869729.923921:0:15571:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788869729.923924:0:15571:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:1.0:1788869729.924126:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869729.924134:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9600/0xbead52e175fc2c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2c4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869729.924142:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a9600 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1788869729.924146:0:7425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9600/0xbead52e175fc2c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2c4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869729.924155:0:7425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9600/0xbead52e175fc2c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xbead52e175fc2c4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869729.924162:0:7425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9600/0xbead52e175fc2c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xbead52e175fc2c4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869729.924168:0:7425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788869729.924179:0:7425:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788869729.924181:0:7425:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788869729.924198:0:7425:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffae58e800 00010000:00010000:1.0:1788869729.924202:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9600/0xbead52e175fc2c43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xbead52e175fc2c4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869729.924209:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9600/0xbead52e175fc2c43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xbead52e175fc2c4a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869729.924220:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869729.924221:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869729.924223:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869729.924901:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1875765554742656:0@lo:38:kworker.0 00000100:00080000:3.0:1788869729.926091:0:15571:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788869729.926104:0:15571:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fe839bd500 x1875765554742784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869743 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869729.926137:0:15571:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788869729.926143:0:15571:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788869729.926166:0:15571:0:(import.c:65:import_set_state_nolock()) ffff99fe81f17800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788869729.926418:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554742784:0@lo:400:kworker.0 00000100:00100000:2.0:1788869729.929087:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1875765554743168:0@lo:39:umount.0 00000400:00000100:2.0:1788869729.929141:0:3615:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765554743168 offset 0 length 224: 4 00000100:00080000:0.0:1788869730.136531:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 46892796-b77d-4866-a7cc-ce4160dea4be->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788869730.136543:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 46892796-b77d-4866-a7cc-ce4160dea4be->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869730.136547:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788869730.136550:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788869730.136635:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554743296:0@lo:400:kworker.0 00000400:00000100:1.0:1788869730.136710:0:3616:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765554743296 offset 0 length 224: 4 00010000:00010000:2.0:1788869730.394097:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869731.416595:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788869732.184490:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 46892796-b77d-4866-a7cc-ce4160dea4be->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788869732.184501:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 46892796-b77d-4866-a7cc-ce4160dea4be->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869732.184516:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788869732.184520:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788869732.184676:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869732.184698:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554743424:0@lo:400:kworker.0 00000400:00000100:1.0:1788869732.184755:0:3616:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765554743424 offset 0 length 224: 4 00000001:00100000:2.0:1788869732.251330:0:8393:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788869732.251339:0:8393:0:(genops.c:906:class_export_put()) final put ffff99fe81f11000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788869732.251415:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe81f11000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788869732.251464:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99fe81f10800 for lustre-OST0000 00000001:00100000:2.0:1788869732.257078:0:9476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788869732.257091:0:9476:0:(genops.c:906:class_export_put()) final put ffff99fe82ef0000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788869732.257212:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe82ef0000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788869732.257286:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99fe82ef5800 for lustre-OST0001 00010000:00010000:1.0:1788869732.440456:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869733.467204:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869734.489004:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869735.064485:0:3615:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869725/real 1788869725] req@ffff99ffae6afb80 x1875765554742528/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788869735 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869735.064591:0:3615:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99ffae6afb80 x1875765554742528/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788869735 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788869735.064614:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffae58e800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869735.064642:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788869735.064647:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:46892796-b77d-4866-a7cc-ce4160dea4be:3615:1875765554742528:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:1.0:1788869735.064750:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 46892796-b77d-4866-a7cc-ce4160dea4be->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788869735.064756:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788869735.064759:0:36:0:(import.c:65:import_set_state_nolock()) ffff99ffae58e800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788869735.064764:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.130@tcp: connect to NID 0@lo last attempt 343 00000100:00080000:1.0:1788869735.064769:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.130@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788869735.064776:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.130@tcp: import ffff99ffae58e800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1788869735.064814:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffbfb1f800 x1875765554743552/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788869735.064838:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788869735.064842:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788869735.064965:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875765554743680:0@lo:400:kworker.0 00000400:00000100:3.0:1788869735.065019:0:3618:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765554743680 offset 0 length 224: 4 00000100:00100000:2.0:1788869735.065241:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:46892796-b77d-4866-a7cc-ce4160dea4be:3615:1875765554743552:0@lo:250:kworker.0 00000400:00000100:2.0:1788869735.065285:0:3615:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765554743552 offset 0 length 520: 4 00010000:00010000:1.0:1788869735.512625:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869736.536596:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869737.560693:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869738.584764:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869739.160840:0:3615:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869729/real 1788869729] req@ffff99ffae6ac380 x1875765554743168/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788869739 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869739.160881:0:3615:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99ffae6ac380 x1875765554743168/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788869739 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788869739.160902:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99fe81f17800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788869739.160926:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1875765554743168:0@lo:39:umount.0 00000100:00080000:3.0:1788869739.161020:0:15571:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788869739.161025:0:15571:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788869739.161031:0:15571:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788869739.164689:0:15571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3800/0xbead52e175fc2c51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869739.164707:0:15571:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3800/0xbead52e175fc2c51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2c58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869739.164714:0:15571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3800/0xbead52e175fc2c51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2c58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869739.164721:0:15571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3800/0xbead52e175fc2c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2c58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869739.164812:0:15571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869739.164820:0:15571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3200/0xbead52e175fc2ed5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2edc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869739.164828:0:15571:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3200/0xbead52e175fc2ed5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2edc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869739.164835:0:15571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3200/0xbead52e175fc2ed5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2edc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869739.164840:0:15571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3200/0xbead52e175fc2ed5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2edc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869739.171969:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869739.171985:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3800/0xbead52e175fc2c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2c58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869739.171998:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb98e3800 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1788869739.172003:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3800/0xbead52e175fc2c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2c58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869739.172013:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3800/0xbead52e175fc2c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xbead52e175fc2c58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869739.172039:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3800/0xbead52e175fc2c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xbead52e175fc2c58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869739.172044:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788869739.172047:0:6472:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1788869739.172062:0:6472:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffae58e800 00010000:00010000:2.0:1788869739.172067:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3800/0xbead52e175fc2c51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xbead52e175fc2c58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869739.172074:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3800/0xbead52e175fc2c51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xbead52e175fc2c58 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869739.172092:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869739.172097:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3200/0xbead52e175fc2ed5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2edc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869739.172102:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb98e3200 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1788869739.172105:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3200/0xbead52e175fc2ed5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2edc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869739.172127:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3200/0xbead52e175fc2ed5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbead52e175fc2edc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869739.172134:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3200/0xbead52e175fc2ed5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbead52e175fc2edc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869739.172139:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788869739.172141:0:6472:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788869739.172145:0:6472:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffae58e800 00010000:00010000:2.0:1788869739.172154:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3200/0xbead52e175fc2ed5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbead52e175fc2edc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869739.172161:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869739.172163:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869739.172164:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869739.174411:0:15571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788869739.174443:0:15571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3200/0xbead52e175fc2ed5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbead52e175fc2edc expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869739.174476:0:15571:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788869739.174485:0:15571:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1788869739.174487:0:15571:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788869739.176960:0:15571:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788869739.176969:0:15571:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788869739.176979:0:15571:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788869739.176986:0:15571:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788869739.176992:0:15571:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff99ffc10f19c0) has no exports 00000020:00080000:3.0:1788869739.177021:0:15571:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff99ffc10f19c0) has no exports 00010000:00010000:2.0:1788869739.180237:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788869739.180698:0:15571:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99ffbfa14ae0 - data ffff99fe818ca5e8/ffff99fe832c5400 00000020:01000000:0.0:1788869739.182374:0:15571:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99fe820cb480 - data ffff99ffb3a5b000/ffff99fe82210800 00100000:10000000:0.0:1788869739.218176:0:15571:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788869739.252013:0:15571:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc29a3 00000020:00000080:2.0:1788869739.252023:0:15571:0:(genops.c:906:class_export_put()) final put ffff99fe81cc8800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788869739.252039:0:15571:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffc10cf800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788869739.252043:0:15571:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffc10cf800 2 00000020:01000004:2.0:1788869739.252046:0:15571:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ffc10cf800 from lustre-OST0000 00000020:00000080:0.0:1788869739.252059:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe81cc8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788869739.252071:0:15571:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869739.252081:0:15571:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788869739.252084:0:15571:0:(genops.c:906:class_export_put()) final put ffff99ffbbf37800/lustre-OST0000_UUID 00000020:00000080:2.0:1788869739.252086:0:15571:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffbbf37800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788869739.252091:0:15571:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788869739.252182:0:15571:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788869739.252188:0:15571:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788869739.252192:0:15571:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869739.252197:0:15571:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788869739.252203:0:15571:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff99fe81f16000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788869739.252208:0:15571:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff99ff95513380) has exports, disconnecting them 00000020:00080000:2.0:1788869739.252213:0:15571:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff99fe81f16000), last request at 1788869501 00000020:00000080:2.0:1788869739.252216:0:15571:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc29cd 00000020:00080000:2.0:1788869739.252226:0:15571:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99fe81f16000): rc 0 00000020:00000080:2.0:1788869739.252230:0:15571:0:(genops.c:906:class_export_put()) final put ffff99fe81f16000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788869739.253036:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe81f16000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788869739.255490:0:15571:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788869739.255499:0:15571:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788869739.255528:0:15571:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788869739.255555:0:15571:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788869739.255721:0:15571:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869739.255730:0:15571:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788869739.255737:0:15571:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788869739.255742:0:15571:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869739.255746:0:15571:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788869739.255753:0:15571:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff99fe81f12000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788869739.255760:0:15571:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff99ff955ccd40) has exports, disconnecting them 00000020:00080000:2.0:1788869739.255765:0:15571:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff99fe81f12000), last request at 1788869501 00000020:00000080:2.0:1788869739.255769:0:15571:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc29e2 00000020:00080000:2.0:1788869739.255784:0:15571:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99fe81f12000): rc 0 00000020:00000080:2.0:1788869739.255789:0:15571:0:(genops.c:906:class_export_put()) final put ffff99fe81f12000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788869739.256854:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99fe81f37800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788869739.256866:0:36:0:(genops.c:906:class_export_put()) final put ffff99fe81f35800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788869739.256870:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe81f35800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788869739.256888:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788869739.256964:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe81f12000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1788869739.263335:0:15571:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788869739.263346:0:15571:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788869739.263350:0:15571:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788869739.263358:0:15571:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788869739.263386:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99fe81f17800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788869739.263538:0:15571:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788869739.263547:0:15571:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1788869739.263552:0:15571:0:(genops.c:906:class_export_put()) final put ffff99fe81f17000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1788869739.263556:0:15571:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe81f17000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1788869739.263566:0:15571:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1788869739.263632:0:15571:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffc10cf800 1 00000020:00000080:0.0:1788869739.263638:0:15571:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc296b 00000020:00000080:0.0:1788869739.263645:0:15571:0:(genops.c:906:class_export_put()) final put ffff99ffb9aa8000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788869739.263654:0:15571:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788869739.263661:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffb9aa8000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788869739.263670:0:15571:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788869739.263674:0:15571:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788869739.263678:0:15571:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff99ffc10f0000) has no exports 00000020:00000080:0.0:1788869739.299048:0:15571:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788869739.299066:0:15571:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788869739.299073:0:15571:0:(genops.c:906:class_export_put()) final put ffff99ffb9722800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788869739.299078:0:15571:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffb9722800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788869739.299094:0:15571:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788869739.299246:0:15571:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99ffb89f7800 00000020:02000400:0.0:1788869739.299328:0:15571:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788869739.608481:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788869740.440838:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 46892796-b77d-4866-a7cc-ce4160dea4be->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788869740.440849:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 46892796-b77d-4866-a7cc-ce4160dea4be->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788869740.440852:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788869740.440855:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788869740.440926:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554743808:0@lo:400:kworker.0 00000400:00000100:2.0:1788869740.440989:0:3619:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765554743808 offset 0 length 224: 4 00010000:00010000:2.0:1788869740.634425:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869741.658505:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869742.232330:0:3615:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869727/real 1788869727] req@ffff99fe839bf480 x1875765554742912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788869742 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869742.232362:0:3615:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99fe839bf480 x1875765554742912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788869742 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788869742.232382:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99fe82ef7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788869742.232406:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788869742.232410:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3615:1875765554742912:0@lo:38:kworker.0 00000100:00080000:0.0:1788869742.232481:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 46892796-b77d-4866-a7cc-ce4160dea4be->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788869742.232487:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 46892796-b77d-4866-a7cc-ce4160dea4be->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869742.232489:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788869742.232492:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788869742.232495:0:36:0:(import.c:65:import_set_state_nolock()) ffff99fe82ef7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869742.232500:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 345 00000100:00080000:0.0:1788869742.232504:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788869742.232511:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99fe82ef7000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788869742.232559:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe839bd180 x1875765554743936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788869742.232616:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869742.232629:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554744064:0@lo:400:kworker.0 00000400:00000100:0.0:1788869742.232689:0:3617:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765554744064 offset 0 length 224: 4 00000100:00100000:1.0:1788869742.232852:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3615:1875765554743936:0@lo:38:kworker.0 00000400:00000100:1.0:1788869742.232876:0:3615:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765554743936 offset 0 length 520: 4 00000020:01000004:2.0:1788869742.387433:0:15773:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1788869742.407654:0:15773:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788869742.407734:0:15773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3e00/0xbead52e175fc2c27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c2e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869742.407749:0:15773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3e00/0xbead52e175fc2c27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2c2e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869742.407773:0:15773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3e00/0xbead52e175fc2c27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2c2e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869742.407780:0:15773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3e00/0xbead52e175fc2c27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2c2e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869742.407837:0:15773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788869742.407842:0:15773:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788869742.407864:0:15773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788869742.407876:0:15773:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fe839bd180 x1875765554743936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788869762 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869742.407899:0:15773:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788869742.407904:0:15773:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788869742.407909:0:15773:0:(import.c:65:import_set_state_nolock()) ffff99fe82ef7000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788869742.407913:0:15773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788869742.407917:0:15773:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fe839bd180 x1875765554743936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788869762 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869742.407924:0:15773:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788869742.407927:0:15773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 26s for inflight to error out 00000100:00100000:3.0:1788869742.408081:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3615:1875765554743936:0@lo:38:kworker.0 00000100:00080000:2.0:1788869742.409246:0:15773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788869742.409282:0:15773:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fe839bdf80 x1875765554743040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869743 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869742.409302:0:15773:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fe839bf800 x1875765554743296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869746 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869742.409317:0:15773:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fe839bdc00 x1875765554743424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869748 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869742.409326:0:15773:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ffbfb1d880 x1875765554743680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869751 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869742.409350:0:15773:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fe84019180 x1875765554743808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869756 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869742.409358:0:15773:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fe839bc700 x1875765554744064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869758 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869742.409367:0:15773:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1788869742.409392:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554743424:0@lo:400:kworker.0 00000100:00100000:2.0:1788869742.409399:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554743296:0@lo:400:kworker.0 00000100:00100000:2.0:1788869742.409429:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875765554743680:0@lo:400:kworker.0 00000100:00080000:2.0:1788869742.409441:0:15773:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788869742.409460:0:15773:0:(import.c:65:import_set_state_nolock()) ffff99fe83094000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788869742.409541:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554743808:0@lo:400:kworker.0 00000100:00100000:3.0:1788869742.409550:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554743040:0@lo:400:kworker.0 00000100:00100000:3.0:1788869742.409572:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3615:1875765554744192:0@lo:39:umount.0 00000400:00000100:3.0:1788869742.409613:0:3615:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765554744192 offset 0 length 224: 4 00000100:00100000:0.0:1788869742.409723:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875765554744064:0@lo:400:kworker.0 00010000:00010000:1.0:1788869742.409783:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869742.409791:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3e00/0xbead52e175fc2c27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2c2e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869742.409801:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb98e3e00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1788869742.409805:0:7425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3e00/0xbead52e175fc2c27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2c2e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869742.409815:0:7425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3e00/0xbead52e175fc2c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbead52e175fc2c2e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869742.409829:0:7425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3e00/0xbead52e175fc2c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbead52e175fc2c2e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869742.409835:0:7425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788869742.409837:0:7425:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788869742.409839:0:7425:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788869742.409853:0:7425:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffae58e800 00010000:00010000:1.0:1788869742.409857:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3e00/0xbead52e175fc2c27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbead52e175fc2c2e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869742.409863:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb98e3e00/0xbead52e175fc2c27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbead52e175fc2c2e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869742.409874:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869742.409876:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869742.409878:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869742.682216:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869743.705565:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869744.729744:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869745.752851:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869746.776406:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788869747.608455:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 46892796-b77d-4866-a7cc-ce4160dea4be->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788869747.608466:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 46892796-b77d-4866-a7cc-ce4160dea4be->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788869747.802998:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869748.825162:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869749.848718:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869750.616391:0:3615:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869735/real 1788869735] req@ffff99ffbfb1f800 x1875765554743552/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788869750 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869750.616425:0:3615:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99ffbfb1f800 x1875765554743552/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788869750 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788869750.616454:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffae58e800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869750.616478:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788869750.616482:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:46892796-b77d-4866-a7cc-ce4160dea4be:3615:1875765554743552:0@lo:250:kworker.0 00000100:00080000:2.0:1788869750.616663:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 46892796-b77d-4866-a7cc-ce4160dea4be->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788869750.616669:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788869750.616671:0:37:0:(import.c:65:import_set_state_nolock()) ffff99ffae58e800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869750.616676:0:37:0:(import.c:510:import_select_connection()) MGC192.168.201.130@tcp: connect to NID 0@lo last attempt 352 00000100:00080000:2.0:1788869750.616681:0:37:0:(import.c:589:import_select_connection()) MGC192.168.201.130@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788869750.616688:0:37:0:(import.c:624:import_select_connection()) MGC192.168.201.130@tcp: import ffff99ffae58e800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788869750.616722:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe8401ad80 x1875765554744320/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788869750.616785:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:46892796-b77d-4866-a7cc-ce4160dea4be:3615:1875765554744320:0@lo:250:kworker.0 00000400:00000100:0.0:1788869750.616833:0:3615:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765554744320 offset 0 length 520: 4 00010000:00010000:1.0:1788869750.872491:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869751.898277:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869752.664921:0:3615:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869742/real 1788869742] req@ffff99fe84019880 x1875765554744192/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788869752 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869752.664978:0:3615:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99fe84019880 x1875765554744192/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788869752 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788869752.665005:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99fe83094000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788869752.665036:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3615:1875765554744192:0@lo:39:umount.0 00000100:00080000:2.0:1788869752.665715:0:15773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788869752.665722:0:15773:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788869752.665728:0:15773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788869752.667780:0:15773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8200/0xbead52e175fc2c35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2c3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869752.667800:0:15773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8200/0xbead52e175fc2c35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2c3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869752.667808:0:15773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8200/0xbead52e175fc2c35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2c3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869752.667815:0:15773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8200/0xbead52e175fc2c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2c3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869752.667855:0:15773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869752.667864:0:15773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ec7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc2ece expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869752.667871:0:15773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ec7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc2ece expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869752.667878:0:15773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ec7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2ece expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869752.667885:0:15773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbead52e175fc2ece expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869752.667909:0:15773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788869752.667915:0:15773:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788869752.667959:0:15773:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788869752.667964:0:15773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788869752.667969:0:15773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869752.667976:0:15773:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788869752.667981:0:15773:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff99fe82cd99c0) has no exports 00000020:00080000:2.0:1788869752.668008:0:15773:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff99fe82cd99c0) has no exports 00010000:00010000:1.0:1788869752.668298:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788869752.668308:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8200/0xbead52e175fc2c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2c3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869752.668318:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a8200 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1788869752.668324:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8200/0xbead52e175fc2c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2c3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869752.668348:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8200/0xbead52e175fc2c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbead52e175fc2c3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869752.668356:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8200/0xbead52e175fc2c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbead52e175fc2c3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869752.668362:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788869752.668364:0:6473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788869752.668366:0:6473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788869752.668383:0:6473:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffae58e800 00010000:00010000:1.0:1788869752.668388:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8200/0xbead52e175fc2c35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbead52e175fc2c3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869752.668395:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8200/0xbead52e175fc2c35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbead52e175fc2c3c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869752.668410:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869752.668414:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2ece expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869752.668420:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a9400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1788869752.668423:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbead52e175fc2ece expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869752.668430:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbead52e175fc2ece expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869752.668436:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbead52e175fc2ece expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869752.668466:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788869752.668468:0:6473:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788869752.668469:0:6473:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788869752.668579:0:6473:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffae58e800 00010000:00010000:1.0:1788869752.668584:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ec7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbead52e175fc2ece expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869752.668590:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb95a9400/0xbead52e175fc2ec7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbead52e175fc2ece expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869752.668672:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869752.668674:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869752.668676:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869752.672518:0:7425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788869752.674520:0:15773:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99fe822868a0 - data ffff99ffb3a7e288/ffff99fe8336ec00 00000020:01000000:2.0:1788869752.674683:0:15773:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99fe82e980c0 - data ffff99fe81859ca8/ffff99fe83369c00 00100000:10000000:2.0:1788869752.680811:0:15773:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788869752.691014:0:15773:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2ac9 00000020:00000080:0.0:1788869752.691025:0:15773:0:(genops.c:906:class_export_put()) final put ffff99fe81f32800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788869752.691048:0:15773:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffb9bbc800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788869752.691052:0:15773:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffb9bbc800 2 00000020:01000004:0.0:1788869752.691055:0:15773:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99ffb9bbc800 from lustre-OST0001 00000020:00000080:0.0:1788869752.691079:0:15773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788869752.691088:0:15773:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788869752.691090:0:15773:0:(genops.c:906:class_export_put()) final put ffff99fe81f31000/lustre-OST0001_UUID 00000020:00000080:0.0:1788869752.691093:0:15773:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe81f31000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788869752.691099:0:15773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788869752.691209:0:15773:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 46892796-b77d-4866-a7cc-ce4160dea4be->MGS 00010000:00010000:0.0:1788869752.691223:0:15773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ff829cfa00/0xbead52e175fc2822 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbead52e175fc2829 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869752.691236:0:15773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ff829cfa00/0xbead52e175fc2822 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbead52e175fc2829 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869752.691242:0:15773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788869752.691245:0:15773:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788869752.691248:0:15773:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788869752.691287:0:15773:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffae58e800 00010000:00010000:0.0:1788869752.691292:0:15773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ff829cfa00/0xbead52e175fc2822 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbead52e175fc2829 expref: -99 pid: 7413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869752.691314:0:15773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2800/0xbead52e175fc2c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbead52e175fc2c9e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869752.691322:0:15773:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2800/0xbead52e175fc2c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbead52e175fc2c9e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869752.691327:0:15773:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788869752.691329:0:15773:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788869752.691331:0:15773:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788869752.691350:0:15773:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99ffae58e800 00010000:00010000:0.0:1788869752.691353:0:15773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb98e2800/0xbead52e175fc2c97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbead52e175fc2c9e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788869752.691369:0:15773:0:(import.c:65:import_set_state_nolock()) ffff99ffae58e800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788869752.691374:0:15773:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788869752.691376:0:15773:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788869752.691377:0:15773:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788869752.691381:0:15773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788869752.691390:0:15773:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99fe8401ad80 x1875765554744320/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788869770 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788869752.691408:0:15773:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788869752.691411:0:15773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000020:00000080:2.0:1788869752.691566:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe81f32800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1788869752.691898:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:46892796-b77d-4866-a7cc-ce4160dea4be:3615:1875765554744320:0@lo:250:kworker.0 10000000:01000000:0.0:1788869752.692195:0:15773:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788869752.692202:0:15773:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc271f 00000020:00000080:0.0:1788869752.692207:0:15773:0:(genops.c:906:class_export_put()) final put ffff99ff8b159000/46892796-b77d-4866-a7cc-ce4160dea4be 00000020:01000000:0.0:1788869752.692276:0:15773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.130@tcp (flags='') 00000020:00000080:0.0:1788869752.692283:0:15773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788869752.692288:0:15773:0:(obd_config.c:955:class_cleanup()) MGC192.168.201.130@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788869752.692292:0:15773:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff99ff8b770000) has no exports 10000000:01000000:1.0:1788869752.692514:0:6481:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788869752.692604:0:15773:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.130@tcp: client import never connected 00000100:00080000:0.0:1788869752.692614:0:15773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788869752.692616:0:15773:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788869752.692618:0:15773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788869752.692620:0:15773:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788869752.692768:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99ff8b159000/46892796-b77d-4866-a7cc-ce4160dea4be for MGC192.168.201.130@tcp 00000020:00000080:0.0:1788869752.693003:0:15773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788869752.693009:0:15773:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.130@tcp (uuid 46892796-b77d-4866-a7cc-ce4160dea4be) 00000020:01000000:0.0:1788869752.693015:0:15773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788869752.693019:0:15773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788869752.693022:0:15773:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788869752.693027:0:15773:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff99fe82ef6000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788869752.693032:0:15773:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff99fe82cdb380) has exports, disconnecting them 00000020:00080000:0.0:1788869752.693036:0:15773:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff99fe82ef6000), last request at 1788869527 00000020:00000080:0.0:1788869752.693039:0:15773:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2af3 00000020:00080000:0.0:1788869752.693050:0:15773:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99fe82ef6000): rc 0 00000020:00000080:0.0:1788869752.693053:0:15773:0:(genops.c:906:class_export_put()) final put ffff99fe82ef6000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788869752.694096:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ffae58e800 for MGC192.168.201.130@tcp 00000020:00000080:2.0:1788869752.694105:0:37:0:(genops.c:906:class_export_put()) final put ffff99ffae58a800/46892796-b77d-4866-a7cc-ce4160dea4be 00000020:00000080:2.0:1788869752.694109:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffae58a800/46892796-b77d-4866-a7cc-ce4160dea4be for MGC192.168.201.130@tcp 00000020:01000000:2.0:1788869752.694115:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.130@tcp (46892796-b77d-4866-a7cc-ce4160dea4be) 00000020:00000080:2.0:1788869752.694607:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe82ef6000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788869752.696431:0:15773:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788869752.696438:0:15773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788869752.696442:0:15773:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788869752.696449:0:15773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788869752.696622:0:15773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788869752.696631:0:15773:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1788869752.696637:0:15773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788869752.696642:0:15773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869752.696646:0:15773:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788869752.696652:0:15773:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff99fe83093800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788869752.696659:0:15773:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff99fe82cdcd40) has exports, disconnecting them 00000020:00080000:1.0:1788869752.696662:0:15773:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff99fe83093800), last request at 1788869527 00000020:00000080:1.0:1788869752.696666:0:15773:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2b08 00000020:00080000:1.0:1788869752.696693:0:15773:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99fe83093800): rc 0 00000020:00000080:1.0:1788869752.696698:0:15773:0:(genops.c:906:class_export_put()) final put ffff99fe83093800/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1788869752.697432:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99fe82ef7000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788869752.697440:0:37:0:(genops.c:906:class_export_put()) final put ffff99fe82ef2800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788869752.697444:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe82ef2800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788869752.697450:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788869752.697511:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe83093800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1788869752.713471:0:15773:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788869752.713480:0:15773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788869752.713484:0:15773:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788869752.713492:0:15773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788869752.713527:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99fe83094000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1788869752.713590:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788869752.713902:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788869752.714065:0:7425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788869752.714280:0:6467:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff99ffae760c00:6467] 0 exiting: rc = 1 00000100:00100000:3.0:1788869752.714403:0:6468:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff99ff89933400:6468] 1 exiting: rc = 0 00000100:00100000:2.0:1788869752.714609:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.716442:0:6471:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff99ff89af8600:6471] 2 exiting: rc = 0 00000100:00100000:2.0:1788869752.716565:0:9487:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff99fe82273600:9487] 3 exiting: rc = 0 00000100:00100000:2.0:1788869752.719380:0:6469:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff99ff89af8800:6469] 0 exiting: rc = 1 00000100:00100000:0.0:1788869752.720657:0:9488:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff99fe81f1d400:9488] 4 exiting: rc = 0 00000100:00100000:0.0:1788869752.720768:0:6470:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff99ff879f4600:6470] 1 exiting: rc = 0 00000100:00100000:2.0:1788869752.720906:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.720915:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.720920:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.720927:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.720933:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.720940:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.720946:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.720952:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.720957:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.720964:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.720969:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.720974:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.720980:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.720986:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.720993:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.720998:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721003:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721009:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721014:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721020:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721025:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721030:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721034:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721039:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721045:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721050:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721055:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721061:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721066:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721090:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721109:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721114:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721119:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721123:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721129:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721134:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721139:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721144:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721148:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721153:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721158:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721164:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721169:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721175:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721180:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721186:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721191:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721197:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721202:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721208:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721215:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721220:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721224:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721229:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721235:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721241:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721246:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721274:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721281:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721287:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721293:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721299:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721305:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.721312:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788869752.724354:0:15773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869752.724377:0:15773:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788869752.724384:0:15773:0:(genops.c:906:class_export_put()) final put ffff99fe82ef4800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788869752.724389:0:15773:0:(genops.c:865:class_export_destroy()) destroying export ffff99fe82ef4800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788869752.724394:0:15773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788869752.724442:0:15773:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffb9bbc800 1 00000020:00000080:2.0:1788869752.724447:0:15773:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbead52e175fc2a98 00000020:00000080:2.0:1788869752.724453:0:15773:0:(genops.c:906:class_export_put()) final put ffff99ffb9bbf000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788869752.724503:0:15773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788869752.724508:0:15773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869752.724512:0:15773:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788869752.724516:0:15773:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff99fe82334d40) has no exports 00000020:00000080:0.0:1788869752.726886:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffb9bbf000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788869752.750092:0:15773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788869752.750108:0:15773:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788869752.750113:0:15773:0:(genops.c:906:class_export_put()) final put ffff99ffb9bb8800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788869752.750118:0:15773:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffb9bb8800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788869752.750130:0:15773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788869752.750668:0:15773:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99ffb9bb8000 00000020:01000000:0.0:1788869752.750693:0:15773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788869752.750698:0:15773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788869752.750702:0:15773:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788869752.750707:0:15773:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff99ff955cb380) has no exports 00000020:00000080:0.0:1788869752.750739:0:15773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788869752.750754:0:15773:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788869752.750757:0:15773:0:(genops.c:906:class_export_put()) final put ffff99ffb9aaf800/OSS_uuid 00000020:00000080:0.0:1788869752.750760:0:15773:0:(genops.c:865:class_export_destroy()) destroying export ffff99ffb9aaf800/OSS_uuid for OSS 00000020:01000000:0.0:1788869752.750764:0:15773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1788869752.750902:0:6480:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788869752.751150:0:8399:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff99ffb9715600:8399] 0 exiting: rc = 1 00000100:00100000:3.0:1788869752.751205:0:8401:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff99ffb97f4400:8401] 2 exiting: rc = 0 00000100:00100000:3.0:1788869752.751312:0:8400:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff99ffb97f5c00:8400] 1 exiting: rc = 0 00000100:00100000:0.0:1788869752.751536:0:8527:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff99fe81c4b800:8527] 3 exiting: rc = 0 00000100:00100000:2.0:1788869752.755033:0:14581:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff99fe84092400:14581] 4 exiting: rc = 0 00000100:00100000:0.0:1788869752.755196:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755206:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755213:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755220:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755228:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755244:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755276:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755283:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755288:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755295:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755300:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755305:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755311:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755316:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755321:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755325:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755331:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755336:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755341:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755356:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755361:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755367:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755372:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755377:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755382:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755387:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755393:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755398:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755403:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755408:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755428:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755434:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755440:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755445:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755450:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755456:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755461:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755466:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755471:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755475:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755479:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755485:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755490:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755495:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755499:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755505:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755510:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755516:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755521:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755526:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755530:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755535:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755540:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755556:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755562:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755568:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755573:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755579:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755584:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755589:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755596:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755601:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755607:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.755621:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.756465:0:8403:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff99ffb988e000:8403] 1 exiting: rc = 0 00000100:00100000:2.0:1788869752.756648:0:13961:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff99fe8306f600:13961] 2 exiting: rc = 0 00000100:00100000:3.0:1788869752.756872:0:8402:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff99ffb9885800:8402] 0 exiting: rc = 1 00000100:00100000:0.0:1788869752.756979:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.756992:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.756997:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757001:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757005:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757008:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757012:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757015:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757018:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757022:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757025:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757042:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757046:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757050:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757054:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757057:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757060:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757063:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757066:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757069:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757072:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757075:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757078:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757081:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757083:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757087:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757090:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757093:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757096:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757100:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757103:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757106:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757109:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757112:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757115:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757117:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757124:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757127:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757130:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757132:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757135:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757138:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757141:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757144:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757147:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757150:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757153:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757156:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757160:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757163:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757166:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757169:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757172:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757175:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757179:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757183:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757187:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757190:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757194:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757198:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757203:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757208:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757214:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869752.757230:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.758561:0:8405:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff99ffb8b96c00:8405] 1 exiting: rc = 0 00000100:00100000:2.0:1788869752.758752:0:8404:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff99ffb8a6fa00:8404] 0 exiting: rc = 1 00000100:00100000:1.0:1788869752.761462:0:8406:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff99ffb987d400:8406] 2 exiting: rc = 0 00000100:00100000:2.0:1788869752.761655:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761661:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761666:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761669:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761673:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761677:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761680:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761684:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761687:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761696:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761700:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761704:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761707:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761711:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761714:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761718:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761723:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761726:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761741:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761746:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761750:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761754:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761758:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761761:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761765:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761768:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761772:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761775:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761779:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761782:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761785:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761789:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761792:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761805:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761810:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761813:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761817:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761823:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761829:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761834:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761839:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761844:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761850:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761855:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761861:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761867:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761872:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761878:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761883:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761887:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.761890:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.762078:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.762083:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.762095:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.762101:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.762108:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.762114:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.762119:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.762125:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.762130:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.762136:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.762141:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.762146:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869752.762151:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.782591:0:8407:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff99ff8bcfe400:8407] 0 exiting: rc = 1 00000100:00100000:1.0:1788869752.793608:0:8408:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff99ffb8a92400:8408] 1 exiting: rc = 0 00000100:00100000:3.0:1788869752.793822:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793832:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793837:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793857:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793862:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793868:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793873:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793878:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793885:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793890:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793909:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793914:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793920:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793925:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793931:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793936:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793940:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793945:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793949:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793954:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793958:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793963:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793967:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793972:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793977:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793983:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793987:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793992:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.793998:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794004:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794009:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794014:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794019:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794024:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794029:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794035:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794041:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794046:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794060:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794065:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794071:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794076:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794081:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794087:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794093:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794097:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794102:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794107:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794112:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794116:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794121:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794126:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794132:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794137:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794143:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794148:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794154:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794159:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794163:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794168:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794173:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794178:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794183:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869752.794195:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.795726:0:8409:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff99ffb8a8ce00:8409] 0 exiting: rc = 1 00000100:00100000:0.0:1788869752.796109:0:8410:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff99ffb9711600:8410] 1 exiting: rc = 0 00000100:00100000:1.0:1788869752.801474:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801493:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801501:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801507:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801513:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801519:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801553:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801561:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801567:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801572:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801578:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801583:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801588:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801594:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801599:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801604:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801610:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801615:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801635:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801642:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801648:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801654:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801661:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801666:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801672:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801679:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801685:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801704:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801710:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801716:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801737:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801747:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801753:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801759:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801768:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801775:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801782:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801802:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801810:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801815:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801822:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801829:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801851:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801858:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801863:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801869:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801876:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801882:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801887:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801894:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801900:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801905:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801912:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801918:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801943:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801952:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801957:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801963:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801968:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801974:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801980:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.801986:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.802000:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869752.802012:0:15773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788869752.810049:0:15773:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788869771.061406:0:16538:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788869780.187009:0:17139:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788869780.187015:0:17139:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788869780.187016:0:17139:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788869780.187128:0:17139:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99fe81f16800 00000020:01000004:0.0:1788869780.187145:0:17139:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788869780.187157:0:17139:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788869780.188065:0:17139:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99fe82334d40) 00000020:00000080:0.0:1788869780.188084:0:17139:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788869780.239015:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788869780.239427:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788869780.241912:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1788869780.242120:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788869780.242497:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1788869780.242750:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788869780.242929:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788869780.243114:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788869780.243851:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788869780.244046:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788869780.244538:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788869780.244875:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788869780.245493:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788869780.245789:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788869780.245975:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788869780.246489:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1788869780.246801:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788869780.246984:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788869780.247483:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788869780.247808:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1788869780.247994:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788869780.248936:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1788869780.249369:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788869780.249739:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788869780.249963:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788869780.250149:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788869780.250789:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788869780.251009:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788869780.251406:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788869780.251783:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788869780.251973:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1788869780.252337:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788869780.252604:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1788869780.252911:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788869780.254968:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1788869780.255753:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1788869780.255943:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1788869780.256124:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788869780.257111:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1788869780.257574:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788869780.257852:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1788869780.258073:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1788869780.258525:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1788869780.258827:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788869780.259004:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788869780.259382:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788869780.259823:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788869780.262629:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1788869780.263298:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1788869780.263503:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1788869780.263944:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1788869780.264147:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1788869780.264618:0:17139:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:0.0:1788869780.265798:0:17139:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788869780.266018:0:17139:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788869780.266027:0:17139:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788869780.266039:0:17139:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbead52e175fc3cdc 00000020:01000004:0.0:1788869780.266046:0:17139:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788869780.266052:0:17139:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788869780.266057:0:17139:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99fe81f16800 from MGS 00000020:01000004:0.0:1788869780.266061:0:17139:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788869780.266073:0:17139:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99fe82330000) 00000020:00000080:0.0:1788869780.266085:0:17139:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788869780.266143:0:17139:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99fe81f16800 from MGS, refs=2 00080000:01000000:0.0:1788869780.266147:0:17139:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788869780.266151:0:17139:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbead52e175fc3cea 00000100:00100000:0.0:1788869780.266301:0:17139:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788869780.266438:0:17139:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788869780.266445:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788869780.268810:0:17139:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788869780.268818:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788869780.269846:0:17139:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788869780.270002:0:17139:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788869780.270007:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788869780.270711:0:17139:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788869780.270716:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788869780.270984:0:17139:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788869780.270990:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788869780.271809:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869780.271812:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869780.271813:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869780.272117:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869780.272120:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869780.272122:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869780.273870:0:17139:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788869780.286895:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788869780.291504:0:17139:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788869780.299468:0:17151:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788869780.299567:0:17139:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788869780.299628:0:17139:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788869780.310023:0:17139:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788869780.310404:0:17139:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869780.310538:0:17139:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788869780.310542:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788869780.311581:0:17139:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788869780.311592:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788869780.312142:0:17139:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788869780.312156:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788869780.312904:0:17139:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788869780.312927:0:17139:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.130@tcp' 00000020:01000004:3.0:1788869780.312928:0:17139:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788869780.312958:0:17139:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.130@tcp (typ=mgc) 00000020:00000080:3.0:1788869780.312971:0:17139:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.130@tcp (ffff99ffbf908000) 00000020:00000080:3.0:1788869780.312986:0:17139:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788869780.313062:0:17139:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fe83ae0800@MGC192.168.201.130@tcp: add connection 192.168.201.130@tcp at head 00010000:00010000:3.0:1788869780.313197:0:17139:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.130@tcp-0 is initialized 00000040:01000000:3.0:1788869780.313203:0:17139:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788869780.316083:0:17156:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788869780.316543:0:17157:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788869780.316623:0:17139:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.130@tcp (uuid 3bcf8c69-1b38-4063-9d70-15b8a5835bb5) 00000020:00000080:2.0:1788869780.316648:0:17139:0:(genops.c:1406:class_connect()) connect: client 3bcf8c69-1b38-4063-9d70-15b8a5835bb5, cookie 0xbead52e175fc3cf8 00000100:00080000:2.0:1788869780.316662:0:17139:0:(import.c:510:import_select_connection()) MGC192.168.201.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869780.316669:0:17139:0:(import.c:624:import_select_connection()) MGC192.168.201.130@tcp: import ffff99fe83ae0800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788869780.316702:0:17139:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe84019f80 x1875765554744448/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869780.316768:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3615:1875765554744448:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788869780.316837:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788869780.316911:0:17139:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3bcf8c69-1b38-4063-9d70-15b8a5835bb5->MGS 00000020:01000004:2.0:1788869780.316932:0:17139:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788869780.316937:0:17139:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788869780.316950:0:17139:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff99ffb981cd40) 00000020:00000080:2.0:1788869780.316963:0:17139:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788869780.319681:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554744448 00000100:00100000:0.0:1788869780.319695:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554744448 00000100:00100000:0.0:1788869780.319745:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869780.319753:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3615:x1875765554744448:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788869780.319778:0:17153:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 3bcf8c69-1b38-4063-9d70-15b8a5835bb5@0@lo t0 exp 0000000000000000 cur 398 last 0 00000020:00000080:0.0:1788869780.319811:0:17153:0:(genops.c:1406:class_connect()) connect: client 3bcf8c69-1b38-4063-9d70-15b8a5835bb5, cookie 0xbead52e175fc3d06 00000100:00080000:0.0:1788869780.319943:0:17153:0:(import.c:65:import_set_state_nolock()) ffff99ffae5c5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869780.334723:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+5:3615:x1875765554744448:12345-0@lo:250:mount.lustre.0 Request processed in 14958us (17874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869780.334739:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869780.335656:0:3615:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788869780.335669:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.130@tcp: connect to target with instance 0 00000100:00080000:1.0:1788869780.335677:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788869780.335683:0:3615:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788869780.335688:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99fe83ae0800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788869780.335691:0:3615:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788869780.335711:0:3615:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788869780.335718:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3615:1875765554744448:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788869780.336936:0:17139:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788869780.337106:0:17139:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788869780.337119:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788869780.340521:0:17139:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788869780.340532:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788869780.347876:0:17139:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788869780.347887:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788869780.348867:0:17139:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788869780.349018:0:17139:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788869780.349023:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788869780.355383:0:17139:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788869780.355403:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788869780.416558:0:17139:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869780.416754:0:17139:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788869780.416761:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788869780.417908:0:17139:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788869780.417916:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788869780.418603:0:17139:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869780.418760:0:17139:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788869780.418765:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788869780.419471:0:17139:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788869780.419479:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788869780.419977:0:17139:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869780.420104:0:17139:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788869780.420116:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788869780.421062:0:17139:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788869780.421071:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788869780.421745:0:17139:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869780.421878:0:17139:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788869780.421882:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788869780.422490:0:17139:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788869780.422496:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788869780.451149:0:17139:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869780.452552:0:17139:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788869780.452561:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788869780.457541:0:17139:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788869780.457554:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788869780.458383:0:17139:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788869780.458391:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788869780.460193:0:17139:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788869780.460231:0:17139:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788869780.460238:0:17139:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788869780.460511:0:17139:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788869780.460556:0:17139:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.130@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788869780.460560:0:17139:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788869780.460562:0:17139:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788869780.460564:0:17139:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869780.460565:0:17139:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869780.460566:0:17139:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869780.460568:0:17139:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869780.460569:0:17139:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788869780.460571:0:17139:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788869780.460573:0:17139:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869780.460574:0:17139:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788869780.460577:0:17139:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788869780.460579:0:17139:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788869780.460580:0:17139:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788869780.460581:0:17139:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869780.460582:0:17139:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869780.460583:0:17139:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869780.460585:0:17139:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869780.460586:0:17139:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788869780.460587:0:17139:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788869780.460588:0:17139:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869780.460589:0:17139:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788869780.460617:0:17139:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788869780.460637:0:17139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554744576:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788869780.460712:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869780.460768:0:17139:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff88e3e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788869780.460862:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554744576 00000100:00100000:3.0:1788869780.460869:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554744576 00000100:00100000:3.0:1788869780.460925:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869780.460935:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+5:17139:x1875765554744576:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788869780.460981:0:17155:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788869780.460984:0:17155:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788869780.460987:0:17155:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788869780.463622:0:17176:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788869780.464230:0:17155:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:0.0:1788869780.470051:0:17177:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788869780.470062:0:17177:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788869780.470065:0:17177:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788869780.470068:0:17177:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788869780.470740:0:17177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788869780.471192:0:17155:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788869780.471203:0:17155:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788869780.473799:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+5:17139:x1875765554744576:12345-0@lo:253:mount.lustre.0 Request processed in 12856us (13077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869780.473815:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788869780.474710:0:17139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554744576:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788869780.474730:0:17139:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788869780.474734:0:17139:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788869780.474737:0:17139:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788869780.474738:0:17139:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869780.474739:0:17139:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869780.474740:0:17139:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869780.474742:0:17139:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869780.474744:0:17139:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788869780.474745:0:17139:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788869780.474747:0:17139:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869780.474748:0:17139:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788869780.474783:0:17139:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99fe81f16800 from lustre-MDT0000 10000000:01000000:2.0:1788869780.474814:0:17139:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788869780.474817:0:17139:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788869780.474821:0:17139:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99ffbf908000 10000000:01000000:2.0:1788869780.474825:0:17139:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788869780.474832:0:17139:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99ffbf908000 from 1 10000000:01000000:2.0:1788869780.474835:0:17139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788869780.474872:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99fe823c0800/0xbead52e175fc3d0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.474883:0:17139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99fe823c0800/0xbead52e175fc3d0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.474892:0:17139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99fe823c0800/0xbead52e175fc3d0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869780.474912:0:17139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554744704:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788869780.474961:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869780.475035:0:17139:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff892a3240 going to sleep for 11 seconds 00000100:00100000:0.0:1788869780.479217:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554744704 00000100:00100000:0.0:1788869780.479235:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554744704 00000100:00100000:0.0:1788869780.479312:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869780.479322:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+5:17139:x1875765554744704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869780.479339:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869780.479371:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffbfb05c00/0xbead52e175fc3d14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc3d0d expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869780.479398:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffbfb05c00/0xbead52e175fc3d14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc3d0d expref: 6 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869780.479410:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffbfb05c00/0xbead52e175fc3d14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3d0d expref: 6 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869780.479429:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb05c00, rc 0) 00000100:00100000:0.0:1788869780.479521:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+6:17139:x1875765554744704:12345-0@lo:101:mount.lustre.0 Request processed in 201us (4559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869780.479528:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869780.479947:0:17139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554744704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869780.479965:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99fe823c0800/0xbead52e175fc3d0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3d14 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869780.479974:0:17139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99fe823c0800/0xbead52e175fc3d0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc3d14 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869780.480057:0:17139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554744832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869780.480093:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869780.480129:0:17139:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89a52f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869780.480362:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554744832 00000100:00100000:0.0:1788869780.480373:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554744832 00000100:00100000:0.0:1788869780.480397:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788869780.480404:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+6:17139:x1875765554744832:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869780.480582:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+6:17139:x1875765554744832:12345-0@lo:501:mount.lustre.0 Request processed in 178us (488us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788869780.480589:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869780.480654:0:17139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554744832:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788869780.480682:0:17139:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788869780.480701:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99fe823c0800/0xbead52e175fc3d0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3d14 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869780.480709:0:17139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99fe823c0800/0xbead52e175fc3d0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3d14 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869780.480719:0:17139:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99fe81f16800 10000000:01000000:3.0:1788869780.480724:0:17139:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788869780.480727:0:17139:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99fe81f16800 10000000:01000000:3.0:1788869780.480730:0:17139:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788869780.480732:0:17139:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99fe81f16800 from 1 10000000:01000000:3.0:1788869780.480735:0:17139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788869780.480755:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc3d1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869780.480774:0:17139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc3d1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869780.480782:0:17139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc3d1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869780.480794:0:17139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554744960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788869780.480826:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869780.480893:0:17139:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89a52f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869780.483885:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554744960 00000100:00100000:1.0:1788869780.483901:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554744960 00000100:00100000:1.0:1788869780.483991:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788869780.484001:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+6:17139:x1875765554744960:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869780.484018:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869780.484039:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff80030c00/0xbead52e175fc3d22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc3d1b expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869780.484065:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff80030c00/0xbead52e175fc3d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc3d1b expref: 7 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869780.484075:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff80030c00/0xbead52e175fc3d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3d1b expref: 7 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869780.484084:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80030c00, rc 0) 00000100:00100000:1.0:1788869780.484175:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+7:17139:x1875765554744960:12345-0@lo:101:mount.lustre.0 Request processed in 176us (3348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869780.484183:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788869780.484308:0:17139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554744960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869780.484327:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc3d1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3d22 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869780.484336:0:17139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc3d1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc3d22 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869780.484363:0:17139:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788869780.484380:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc3d1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3d22 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869780.484389:0:17139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9e600/0xbead52e175fc3d1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3d22 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869780.484398:0:17139:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788869780.484402:0:17139:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788869780.484408:0:17139:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99fe81f16800 10000000:01000000:3.0:1788869780.484411:0:17139:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788869780.484427:0:17139:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788869780.484712:0:17139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788869780.484740:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f200/0xbead52e175fc3d29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869780.484749:0:17139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f200/0xbead52e175fc3d29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869780.484757:0:17139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f200/0xbead52e175fc3d29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869780.484794:0:17139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554745088:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788869780.484826:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869780.486663:0:17139:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89a52f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869780.487714:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554745088 00000100:00100000:0.0:1788869780.487724:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554745088 00000100:00100000:2.0:1788869780.487813:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869780.487835:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+7:17139:x1875765554745088:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869780.487852:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869780.487872:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fe823c0000/0xbead52e175fc3d30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc3d29 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.487898:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fe823c0000/0xbead52e175fc3d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc3d29 expref: 8 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.487908:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fe823c0000/0xbead52e175fc3d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3d29 expref: 8 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.487917:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0000, rc 0) 00000100:00100000:2.0:1788869780.487980:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+8:17139:x1875765554745088:12345-0@lo:101:mount.lustre.0 Request processed in 147us (3152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869780.487986:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788869780.488217:0:17139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554745088:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869780.488234:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f200/0xbead52e175fc3d29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3d30 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869780.488243:0:17139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f200/0xbead52e175fc3d29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc3d30 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869780.488334:0:17139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554745216:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869780.488375:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869780.488401:0:17139:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89a52f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869780.488568:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554745216 00000100:00100000:0.0:1788869780.488573:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554745216 00000100:00100000:0.0:1788869780.488599:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788869780.488605:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+8:17139:x1875765554745216:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869780.488717:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+9:17139:x1875765554745216:12345-0@lo:501:mount.lustre.0 Request processed in 111us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869780.488723:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788869780.488805:0:17139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554745216:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869780.488829:0:17139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554745344:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869780.488869:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869780.488892:0:17139:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89a52f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869780.488935:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554745344 00000100:00100000:0.0:1788869780.488939:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554745344 00000100:00100000:0.0:1788869780.488995:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788869780.489002:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+9:17139:x1875765554745344:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869780.490019:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+9:17139:x1875765554745344:12345-0@lo:503:mount.lustre.0 Request processed in 1014us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869780.490027:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788869780.490171:0:17139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554745344:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869780.491620:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17178:1875765554745472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869780.491683:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869780.491747:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89a52b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869780.491817:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554745472 00000100:00100000:1.0:1788869780.491824:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554745472 00000100:00100000:1.0:1788869780.491858:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788869780.491867:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+9:17178:x1875765554745472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869780.494025:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+9:17178:x1875765554745472:12345-0@lo:502:llog_process_th.0 Request processed in 2147us (2330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869780.494051:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788869780.494172:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17178:1875765554745472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788869780.494207:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869780.494218:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869780.494220:0:17178:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788869780.494225:0:17178:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788869780.494233:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788869780.494247:0:17178:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99fe823319c0) 00000020:00000080:0.0:1788869780.494290:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788869780.494297:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788869780.494381:0:17178:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788869780.494388:0:17178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbead52e175fc3d3e 00000020:00000080:0.0:1788869780.494687:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788869780.494692:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869780.494695:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869780.494696:0:17178:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788869780.494699:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869780.494702:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869780.494704:0:17178:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788869780.494706:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788869780.494715:0:17178:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99fe82333380) 00000020:00000080:0.0:1788869780.494723:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788869780.494727:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788869780.494729:0:17178:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788869780.494731:0:17178:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788869780.494737:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788869780.494780:0:17178:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99fe81f16800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788869780.494791:0:17178:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99ff8b770000) 00000020:00000080:0.0:1788869780.494797:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788869780.494842:0:17178:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788869780.494846:0:17178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbead52e175fc3d53 00000020:00000080:0.0:1788869780.494930:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788869780.494935:0:17178:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788869780.494940:0:17178:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbead52e175fc3d5a 00080000:01000000:0.0:1788869780.494944:0:17178:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788869780.494947:0:17178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbead52e175fc3d61 00010000:00010000:3.0:1788869780.583071:0:17178:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788869780.583653:0:17178:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1788869780.584741:0:17178:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788869780.585273:0:17178:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99ffbf9099c0) 00000020:00000080:3.0:1788869780.585294:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788869780.585401:0:17178:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788869780.585409:0:17178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbead52e175fc3d6f 00000020:00000080:3.0:1788869780.588609:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788869780.593882:0:17178:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbead52e175fc3d76 00000020:00000080:3.0:1788869780.594577:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788869780.594589:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869780.594595:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869780.594597:0:17178:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788869780.594601:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788869780.594604:0:17178:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788869780.594605:0:17178:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788869780.594607:0:17178:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788869780.594608:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788869780.594611:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869780.594612:0:17178:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788869780.594615:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869780.594620:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869780.594622:0:17178:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788869780.594626:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788869780.594666:0:17178:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788869780.594680:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869780.594683:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869780.594685:0:17178:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788869780.594687:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869780.594691:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869780.594698:0:17178:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788869780.594702:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788869780.594707:0:17178:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:00000080:3.0:1788869780.594734:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788869780.594749:0:17178:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99ffbf90b380) 00000020:00000080:3.0:1788869780.594765:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788869780.594770:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788869780.594824:0:17178:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788869780.594829:0:17178:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788869780.594836:0:17178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbead52e175fc3d84 00010000:00080000:3.0:1788869780.594867:0:17178:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffbbf31000@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:3.0:1788869780.601844:0:17178:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1788869780.604136:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788869780.604152:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788869780.604189:0:17178:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788869780.604220:0:17178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbead52e175fc3d8b 00000100:00080000:0.0:1788869780.604232:0:17178:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788869780.604238:0:17178:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99ffbbf31000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788869780.604800:0:17178:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe839bce00 x1875765554745600/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869780.604832:0:17178:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1788869780.604942:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869780.604947:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869780.604949:0:17178:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788869780.604952:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788869780.604955:0:17178:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1788869780.604956:0:17178:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788869780.604958:0:17178:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788869780.604959:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788869780.604962:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869780.604963:0:17178:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788869780.604966:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788869780.604970:0:17178:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788869780.604974:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869780.604975:0:17178:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788869780.604978:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788869780.604982:0:17178:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:0.0:1788869780.605005:0:17178:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788869780.605008:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788869780.605021:0:17178:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99ff8b774d40) 00000020:00000080:0.0:1788869780.605035:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788869780.605041:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788869780.605118:0:17178:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788869780.605125:0:17178:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788869780.605132:0:17178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbead52e175fc3d99 00010000:00080000:0.0:1788869780.605162:0:17178:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffae5cb800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:0.0:1788869780.605398:0:17178:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1788869780.607488:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554745600:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788869780.607573:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869780.607641:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554745600 00000100:00100000:2.0:1788869780.607650:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554745600 00000100:00100000:2.0:1788869780.607684:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869780.607691:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3615:x1875765554745600:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788869780.607708:0:17165:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1788869780.610074:0:17178:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788869780.610398:0:17178:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788869780.621947:0:17178:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788869780.622345:0:17178:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788869780.625715:0:17178:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:2.0:1788869780.631459:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3615:x1875765554745600:12345-0@lo:38:llog_process_th.0 Request processed in 23758us (23876us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788869780.631476:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788869780.631607:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffbbf31000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869780.631612:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788869780.631617:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554745600:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1788869780.633640:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788869780.633655:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788869780.633699:0:17178:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788869780.633723:0:17178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbead52e175fc3da0 00000100:00080000:1.0:1788869780.633735:0:17178:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788869780.633741:0:17178:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ffae5cb800 using connection 192.168.201.130@tcp/0@lo 00000040:00080000:0.0:1788869780.633754:0:17184:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788869780.633761:0:17184:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1788869780.633778:0:17178:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffbfb1c700 x1875765554745728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788869780.633811:0:17178:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788869780.633886:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869780.633891:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869780.633893:0:17178:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788869780.633896:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788869780.633898:0:17178:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1788869780.633900:0:17178:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788869780.633902:0:17178:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788869780.633903:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788869780.633907:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869780.633908:0:17178:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788869780.633918:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788869780.633923:0:17178:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788869780.633927:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869780.633928:0:17178:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788869780.633931:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788869780.633934:0:17178:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:1.0:1788869780.633959:0:17178:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788869780.633963:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788869780.633975:0:17178:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99fe82cdcd40) 00000020:00000080:1.0:1788869780.633989:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788869780.633994:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788869780.634053:0:17178:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788869780.634059:0:17178:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000100:00100000:0.0:1788869780.634064:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554745728:0@lo:8:llog_process_th.0 00000020:00000080:1.0:1788869780.634067:0:17178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbead52e175fc3dae 00010000:00080000:1.0:1788869780.634101:0:17178:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffb89f1000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.130@tcp at head 00000400:00000100:0.0:1788869780.634129:0:3615:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765554745728 offset 0 length 520: 4 00010000:00010000:1.0:1788869780.634322:0:17178:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788869780.634397:0:17178:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788869780.634414:0:17178:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788869780.644616:0:17178:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869780.645701:0:17178:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788869780.645883:0:17178:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788869780.646666:0:17186:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788869780.646671:0:17186:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788869780.647592:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788869780.647605:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788869780.647644:0:17178:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788869780.647669:0:17178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbead52e175fc3db5 00000100:00080000:0.0:1788869780.647682:0:17178:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788869780.647688:0:17178:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ffb89f1000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788869780.647727:0:17178:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe839bce00 x1875765554745856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869780.647814:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554745856:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788869780.647874:0:3615:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765554745856 offset 0 length 520: 4 00000100:00080000:0.0:1788869780.647975:0:17178:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788869780.648042:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869780.648046:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869780.648048:0:17178:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788869780.648051:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869780.648055:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869780.648057:0:17178:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788869780.648060:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788869780.648062:0:17178:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788869780.648074:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869780.648078:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869780.648079:0:17178:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788869780.648082:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869780.648084:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869780.648086:0:17178:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788869780.648090:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788869780.648119:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17178:1875765554745984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869780.648181:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869780.648213:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554745984 00000100:00100000:0.0:1788869780.648220:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554745984 00000100:00100000:0.0:1788869780.648290:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788869780.648300:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83940450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+9:17178:x1875765554745984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869780.648428:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83940450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+9:17178:x1875765554745984:12345-0@lo:502:llog_process_th.0 Request processed in 129us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869780.648436:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788869780.648481:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff83977180 going to sleep for 11 seconds 00000100:00100000:0.0:1788869780.648502:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17178:1875765554745984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788869780.648526:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869780.648530:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869780.648531:0:17178:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788869780.648535:0:17178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788869780.648593:0:17139:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788869780.648616:0:17139:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788869780.648633:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f200/0xbead52e175fc3d29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3d30 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869780.648644:0:17139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f200/0xbead52e175fc3d29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3d30 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869780.648665:0:17139:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99fe81f16800 from 1 10000000:01000000:0.0:1788869780.648668:0:17139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788869780.648695:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05400/0xbead52e175fc3dbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869780.648703:0:17139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05400/0xbead52e175fc3dbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869780.648712:0:17139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05400/0xbead52e175fc3dbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869780.648725:0:17139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554746112:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788869780.648752:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869780.648768:0:17139:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff83977180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869780.649119:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554746112 00000100:00100000:2.0:1788869780.649125:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554746112 00000100:00100000:2.0:1788869780.649167:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788869780.649181:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+9:17139:x1875765554746112:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869780.649190:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869780.649205:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fe823c1400/0xbead52e175fc3dc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc3dbc expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.649228:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fe823c1400/0xbead52e175fc3dc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc3dbc expref: 10 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.649239:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fe823c1400/0xbead52e175fc3dc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3dbc expref: 10 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.649248:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1400, rc 0) 00000100:00100000:2.0:1788869780.649310:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+10:17139:x1875765554746112:12345-0@lo:101:mount.lustre.0 Request processed in 130us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869780.649316:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788869780.649484:0:17139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554746112:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869780.649498:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05400/0xbead52e175fc3dbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3dc3 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869780.649506:0:17139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05400/0xbead52e175fc3dbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc3dc3 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869780.650134:0:17139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554746240:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788869780.650363:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869780.650450:0:17139:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff83977180 going to sleep for 11 seconds 00000100:00100000:3.0:1788869780.650512:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554746240 00000100:00100000:3.0:1788869780.650519:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554746240 00000100:00100000:3.0:1788869780.650588:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869780.650597:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83942c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+10:17139:x1875765554746240:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788869780.650615:0:17154:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788869780.650624:0:17154:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788869780.650694:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83942c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+10:17139:x1875765554746240:12345-0@lo:256:mount.lustre.0 Request processed in 99us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869780.650702:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788869780.650772:0:17139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554746240:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788869780.651341:0:17139:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788869780.651387:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05400/0xbead52e175fc3dbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3dc3 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869780.651397:0:17139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05400/0xbead52e175fc3dbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3dc3 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869780.651405:0:17139:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99fe81f16800 from 1 10000000:01000000:0.0:1788869780.651408:0:17139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788869780.651436:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04800/0xbead52e175fc3dca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869780.651443:0:17139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04800/0xbead52e175fc3dca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869780.651452:0:17139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04800/0xbead52e175fc3dca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869780.651469:0:17139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554746368:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788869780.651498:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869780.651865:0:17139:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff83977180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869780.651959:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554746368 00000100:00100000:2.0:1788869780.651966:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554746368 00000100:00100000:2.0:1788869780.651995:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788869780.652002:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+10:17139:x1875765554746368:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869780.652012:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869780.652026:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fe823c0200/0xbead52e175fc3dd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc3dca expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.652046:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fe823c0200/0xbead52e175fc3dd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc3dca expref: 11 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.652056:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fe823c0200/0xbead52e175fc3dd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3dca expref: 11 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.652076:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0200, rc 0) 00000100:00100000:2.0:1788869780.652116:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+11:17139:x1875765554746368:12345-0@lo:101:mount.lustre.0 Request processed in 114us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869780.652122:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788869780.652409:0:17139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554746368:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869780.652424:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04800/0xbead52e175fc3dca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3dd1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869780.652433:0:17139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04800/0xbead52e175fc3dca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc3dd1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869780.652486:0:17139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554746496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869780.652511:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869780.652534:0:17139:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff83977180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869780.652579:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554746496 00000100:00100000:2.0:1788869780.652583:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554746496 00000100:00100000:2.0:1788869780.652600:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788869780.652605:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+11:17139:x1875765554746496:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869780.652734:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+11:17139:x1875765554746496:12345-0@lo:501:mount.lustre.0 Request processed in 128us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869780.652741:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788869780.652835:0:17139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554746496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869780.652862:0:17139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554746624:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869780.652905:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869780.652915:0:17139:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff83977180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869780.652965:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554746624 00000100:00100000:2.0:1788869780.652969:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554746624 00000100:00100000:2.0:1788869780.652986:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788869780.652992:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83941850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+11:17139:x1875765554746624:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869780.653070:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83941850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+11:17139:x1875765554746624:12345-0@lo:503:mount.lustre.0 Request processed in 78us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869780.653076:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788869780.653195:0:17139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554746624:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869780.654109:0:17188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17188:1875765554746752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869780.654217:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869780.654247:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8a54240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869780.654308:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554746752 00000100:00100000:2.0:1788869780.654314:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554746752 00000100:00100000:2.0:1788869780.654346:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788869780.654362:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+11:17188:x1875765554746752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869780.654800:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+11:17188:x1875765554746752:12345-0@lo:502:llog_process_th.0 Request processed in 447us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869780.654808:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788869780.654952:0:17188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17188:1875765554746752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788869780.654977:0:17188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869780.654985:0:17188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869780.654988:0:17188:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788869780.654995:0:17188:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99fe81f16800 00000020:00000080:3.0:1788869780.654998:0:17188:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788869780.655005:0:17188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869780.655007:0:17188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869780.655009:0:17188:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788869780.655017:0:17188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869780.655020:0:17188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869780.655021:0:17188:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788869780.655024:0:17188:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99fe81f16800 00000020:00000080:3.0:1788869780.655026:0:17188:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788869780.655115:0:17188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869780.655118:0:17188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869780.655120:0:17188:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788869780.655122:0:17188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869780.655124:0:17188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869780.655125:0:17188:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788869780.655129:0:17188:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99fe81f16800 00000020:00000080:3.0:1788869780.655130:0:17188:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788869780.658285:0:17188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869780.658298:0:17188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869780.658300:0:17188:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788869780.658305:0:17188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869780.658309:0:17188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869780.658311:0:17188:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788869780.658319:0:17188:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99fe81f16800 00000020:00000080:3.0:1788869780.658321:0:17188:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788869780.658414:0:17188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ad180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17188:1875765554746880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869780.658495:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869780.662418:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae62d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788869780.663384:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554746880 00000100:00100000:1.0:1788869780.663394:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554746880 00000100:00100000:1.0:1788869780.663492:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788869780.663503:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+11:17188:x1875765554746880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869780.663693:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+11:17188:x1875765554746880:12345-0@lo:502:llog_process_th.0 Request processed in 191us (5198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869780.663708:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788869780.663818:0:17188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ad180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17188:1875765554746880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788869780.663854:0:17188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869780.663863:0:17188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869780.663865:0:17188:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788869780.663871:0:17188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788869780.671363:0:17139:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788869780.671404:0:17139:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788869780.671432:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04800/0xbead52e175fc3dca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3dd1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.671445:0:17139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04800/0xbead52e175fc3dca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3dd1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869780.671506:0:17139:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788869780.671509:0:17139:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99fe81f16800 10000000:01000000:2.0:1788869780.671512:0:17139:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99fe81f16800 10000000:01000000:2.0:1788869780.671516:0:17139:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788869780.671523:0:17139:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99fe81f16800 from 1 10000000:01000000:2.0:1788869780.671525:0:17139:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788869780.671564:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99fe823c0600/0xbead52e175fc3dd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.671573:0:17139:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99fe823c0600/0xbead52e175fc3dd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.671583:0:17139:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99fe823c0600/0xbead52e175fc3dd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869780.671609:0:17139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554747008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788869780.671672:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869780.671712:0:17139:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8831b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788869780.671857:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554747008 00000100:00100000:1.0:1788869780.671865:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554747008 00000100:00100000:1.0:1788869780.671918:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788869780.671927:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+11:17139:x1875765554747008:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869780.671942:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869780.671959:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff80030000/0xbead52e175fc3ddf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc3dd8 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869780.671980:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff80030000/0xbead52e175fc3ddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc3dd8 expref: 12 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869780.671990:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff80030000/0xbead52e175fc3ddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3dd8 expref: 12 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869780.671999:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80030000, rc 0) 00000100:00100000:1.0:1788869780.672036:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:17139:x1875765554747008:12345-0@lo:101:mount.lustre.0 Request processed in 110us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869780.672042:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788869780.672089:0:17139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554747008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869780.672106:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99fe823c0600/0xbead52e175fc3dd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3ddf expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869780.672115:0:17139:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99fe823c0600/0xbead52e175fc3dd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc3ddf expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869780.672399:0:17139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554747136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869780.672441:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869780.672460:0:17139:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8cbbc240 going to sleep for 11 seconds 00000100:00100000:1.0:1788869780.672488:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554747136 00000100:00100000:1.0:1788869780.672492:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554747136 00000100:00100000:1.0:1788869780.672509:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788869780.672515:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:17139:x1875765554747136:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869780.672628:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:17139:x1875765554747136:12345-0@lo:501:mount.lustre.0 Request processed in 112us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869780.672636:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788869780.672659:0:17139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554747136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869780.672684:0:17139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554747264:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869780.672721:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869780.672730:0:17139:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8cbbc240 going to sleep for 11 seconds 00000100:00100000:1.0:1788869780.672746:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554747264 00000100:00100000:1.0:1788869780.672750:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554747264 00000100:00100000:1.0:1788869780.672766:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788869780.672772:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:17139:x1875765554747264:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869780.672846:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:17139:x1875765554747264:12345-0@lo:503:mount.lustre.0 Request processed in 73us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869780.672853:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788869780.672885:0:17139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554747264:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869780.674014:0:17192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17192:1875765554747392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869780.674068:0:17192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869780.674096:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99b8240 going to sleep for 11 seconds 00000100:00100000:1.0:1788869780.674387:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554747392 00000100:00100000:1.0:1788869780.674393:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554747392 00000100:00100000:1.0:1788869780.674420:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788869780.674428:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83941050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:17192:x1875765554747392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869780.674535:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83941050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:17192:x1875765554747392:12345-0@lo:502:llog_process_th.0 Request processed in 108us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869780.674542:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788869780.674633:0:17192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17192:1875765554747392:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788869780.674691:0:17192:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788869780.674706:0:17192:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99ffb9818000) 00000020:00000080:2.0:1788869780.674725:0:17192:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788869780.674898:0:17192:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99fe81f16800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788869780.674902:0:17192:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99fe81f16800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788869780.674905:0:17192:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99fe81f16800 4 00010000:00080000:2.0:1788869780.674932:0:17192:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fe83861000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:2.0:1788869780.681831:0:17192:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788869780.681938:0:17192:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788869780.681980:0:17192:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788869780.681995:0:17192:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbead52e175fc3ded 00000100:00080000:2.0:1788869780.682006:0:17192:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869780.682013:0:17192:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99fe83861000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788869780.682050:0:17192:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe84018a80 x1875765554747520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869780.682081:0:17192:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788869780.682576:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875765554747520:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788869780.682639:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869780.683274:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554747520 00000100:00100000:1.0:1788869780.683283:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554747520 00000100:00100000:1.0:1788869780.683315:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869780.683322:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3615:x1875765554747520:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788869780.683405:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3615:x1875765554747520:12345-0@lo:38:llog_process_th.0 Request processed in 82us (765us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788869780.683413:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869780.683499:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788869780.683507:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99fe83861000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869780.683512:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788869780.683515:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875765554747520:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788869780.693957:0:17192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17192:1875765554747648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869780.694031:0:17192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869780.694064:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99a6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788869780.694330:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554747648 00000100:00100000:1.0:1788869780.694337:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554747648 00000100:00100000:1.0:1788869780.694393:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788869780.694402:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:17192:x1875765554747648:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869780.694527:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:17192:x1875765554747648:12345-0@lo:502:llog_process_th.0 Request processed in 126us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869780.694534:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788869780.694631:0:17192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17192:1875765554747648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869780.694669:0:17192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17192:1875765554747776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869780.694696:0:17192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869780.694711:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99a6300 going to sleep for 11 seconds 00000100:00100000:0.0:1788869780.694794:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554747776 00000100:00100000:0.0:1788869780.694798:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554747776 00000100:00100000:0.0:1788869780.694974:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788869780.694983:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe832f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:17192:x1875765554747776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869780.695063:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe832f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:17192:x1875765554747776:12345-0@lo:502:llog_process_th.0 Request processed in 81us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869780.695070:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788869780.695220:0:17192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17192:1875765554747776:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788869780.695240:0:17192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788869780.695419:0:17139:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788869780.695440:0:17139:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788869780.695454:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99fe823c0600/0xbead52e175fc3dd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3ddf expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869780.695464:0:17139:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99fe823c0600/0xbead52e175fc3dd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3ddf expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788869780.695510:0:17139:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788869780.695512:0:17139:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788869780.695517:0:17139:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869780.695518:0:17139:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869780.695519:0:17139:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869780.695520:0:17139:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869780.695522:0:17139:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788869780.695523:0:17139:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788869780.695525:0:17139:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869780.695526:0:17139:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788869780.695530:0:17139:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788869780.695532:0:17139:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788869780.695533:0:17139:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788869780.695535:0:17139:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869780.695536:0:17139:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869780.695537:0:17139:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869780.695538:0:17139:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869780.695539:0:17139:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788869780.695540:0:17139:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788869780.695541:0:17139:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869780.695542:0:17139:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788869780.695556:0:17139:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788869780.695567:0:17139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554747904:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788869780.695600:0:17139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869780.695634:0:17139:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8cbbc780 going to sleep for 11 seconds 00000100:00100000:2.0:1788869780.695685:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554747904 00000100:00100000:2.0:1788869780.695689:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554747904 00000100:00100000:2.0:1788869780.695719:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788869780.695727:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:17139:x1875765554747904:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788869780.695749:0:17155:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788869780.695762:0:17155:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788869780.704421:0:17155:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788869780.704445:0:17155:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788869780.704664:0:17176:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788869780.704669:0:17176:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788869780.704690:0:17176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffbfb04000/0xbead52e175fc3df4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869780.704706:0:17176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fe823c1400/0xbead52e175fc3dc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3dbc expref: 12 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869780.704725:0:17176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffbfb04000/0xbead52e175fc3df4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869780.704764:0:17176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fe823c1400/0xbead52e175fc3dc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc3dbc expref: 12 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869780.704778:0:17176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fe823c1400/0xbead52e175fc3dc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc3dbc expref: 12 pid: 17155 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869780.704793:0:17176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bfb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17176:1875765554748032:0@lo:104: 00000100:00100000:0.0:1788869780.704856:0:17176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869780.704901:0:17176:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8833bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869780.705024:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:17139:x1875765554747904:12345-0@lo:253:mount.lustre.0 Request processed in 9296us (9421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869780.705035:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788869780.705123:0:17139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17139:1875765554747904:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788869780.705135:0:17139:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788869780.705138:0:17139:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788869780.705140:0:17139:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788869780.705141:0:17139:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788869780.705142:0:17139:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788869780.705144:0:17139:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788869780.705145:0:17139:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788869780.705206:0:17139:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788869780.705209:0:17139:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788869780.705211:0:17139:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788869780.705212:0:17139:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788869780.705227:0:17139:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788869780.706291:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554748032 00000100:00100000:1.0:1788869780.706301:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554748032 00000100:00100000:1.0:1788869780.706341:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869780.706362:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+3:17176:x1875765554748032:12345-0@lo:104: 00010000:00010000:1.0:1788869780.706378:0:17143:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05400/0xbead52e175fc3dbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3dc3 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869780.706454:0:17143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788869780.706461:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+3:17176:x1875765554748032:12345-0@lo:104: Request processed in 112us (1605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869780.706468:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869780.706512:0:17176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bfb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17176:1875765554748032:0@lo:104: 00010000:00010000:1.0:1788869780.706529:0:17176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffbfb04000/0xbead52e175fc3df4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.706642:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869780.706649:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05400/0xbead52e175fc3dbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3dc3 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.706656:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1788869780.706660:0:17149:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05400/0xbead52e175fc3dbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc3dc3 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.706669:0:17149:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05400/0xbead52e175fc3dbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc3dc3 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869780.706677:0:17149:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05400/0xbead52e175fc3dbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc3dc3 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869780.706683:0:17149:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869780.706724:0:17149:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05400/0xbead52e175fc3dbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3dc3 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.706730:0:17149:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869780.706748:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05400/0xbead52e175fc3dbc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3dc3 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.706756:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05400/0xbead52e175fc3dbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3dc3 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.706783:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869780.706785:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869780.706787:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869780.706891:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869780.706901:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3616:1875765554748160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869780.706936:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869780.706974:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554748160 00000100:00100000:2.0:1788869780.706977:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554748160 00010000:00010000:2.0:1788869780.706994:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fe823c1400/0xbead52e175fc3dc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3dbc expref: 12 pid: 17155 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869780.707013:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869780.707018:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84018000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:3616:x1875765554748160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869780.707028:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869780.707033:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fe823c1400/0xbead52e175fc3dc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3dbc expref: 12 pid: 17155 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.707043:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fe823c1400/0xbead52e175fc3dc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc3dbc expref: 12 pid: 17155 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.707056:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fe823c1400/0xbead52e175fc3dc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc3dbc expref: 12 pid: 17155 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.707068:0:17145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffbfb04000/0xbead52e175fc3df4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.707077:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffbfb04000/0xbead52e175fc3df4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788869780.707100:0:17145:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002431235s 00010000:00010000:2.0:1788869780.707105:0:17145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffbfb04000/0xbead52e175fc3df4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.707112:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffbfb04000/0xbead52e175fc3df4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.707119:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffbfb04000/0xbead52e175fc3df4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.707127:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffbfb04000/0xbead52e175fc3df4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.707133:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04000 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869780.707137:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffbfb04000/0xbead52e175fc3df4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.707144:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffbfb04000/0xbead52e175fc3df4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.707156:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffbfb04000/0xbead52e175fc3df4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869780.707165:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869780.707193:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84018000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+11:3616:x1875765554748160:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869780.707201:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869780.707229:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3616:1875765554748160:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869780.707492:0:17176:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffbfb04000/0xbead52e175fc3df4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869780.707501:0:17176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffbfb04000/0xbead52e175fc3df4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869780.707507:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffbfb04000/0xbead52e175fc3df4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788869780.727213:0:17139:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788869780.728230:0:17139:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788869780.728578:0:17200:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788869780.728583:0:17200:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788869780.728652:0:17201:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1788869780.728990:0:17201:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788869780.731392:0:17139:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1788869780.731834:0:17201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788869780.731897:0:17201:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:1.0:1788869780.732108:0:17202:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff99ffbfb1e680 x1875765554748288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869780.732120:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84e423c0 going to sleep for 0 seconds 00000040:01000000:2.0:1788869780.732642:0:17139:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788869780.732678:0:17139:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788869780.733092:0:17139:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788869780.733098:0:17139:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788869780.733129:0:17139:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869780.734568:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788869780.735103:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788869780.735132:0:17139:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1788869780.736723:0:17139:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1788869780.738795:0:17139:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788869780.740539:0:17139:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788869780.740571:0:17139:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb76cc1557988 00100000:10000000:3.0:1788869780.740578:0:17139:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788869780.741313:0:17139:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788869780.741329:0:17139:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788869780.741358:0:17139:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1788869780.741373:0:17139:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788869780.749945:0:17139:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869780.750140:0:17139:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788869781.337815:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788869781.720957:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788869781.784524:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84e423c0 going to sleep for 0 seconds 10000000:01000000:2.0:1788869782.104817:0:17157:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788869782.104825:0:17157:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99fe81f16800 from 7 10000000:01000000:2.0:1788869782.104830:0:17157:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788869782.104875:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99fe823c0c00/0xbead52e175fc3dfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869782.104887:0:17157:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99fe823c0c00/0xbead52e175fc3dfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869782.104899:0:17157:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99fe823c0c00/0xbead52e175fc3dfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869782.104924:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554748416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869782.104990:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869782.105046:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89a98300 going to sleep for 11 seconds 00000100:00100000:0.0:1788869782.105100:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554748416 00000100:00100000:0.0:1788869782.105107:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554748416 00000100:00100000:0.0:1788869782.105156:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788869782.105162:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+11:17157:x1875765554748416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869782.105183:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869782.105194:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffbfb04e00/0xbead52e175fc3e02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc3dfb expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869782.105212:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffbfb04e00/0xbead52e175fc3e02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc3dfb expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869782.105219:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffbfb04e00/0xbead52e175fc3e02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3dfb expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869782.105225:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04e00, rc 0) 00000100:00100000:0.0:1788869782.105294:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:17157:x1875765554748416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869782.105300:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788869782.105419:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554748416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869782.105431:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99fe823c0c00/0xbead52e175fc3dfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3e02 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869782.105437:0:17157:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99fe823c0c00/0xbead52e175fc3dfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc3e02 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869782.105475:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554748544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788869782.105499:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869782.105518:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae62d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869782.105625:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554748544 00000100:00100000:2.0:1788869782.105629:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554748544 00000100:00100000:2.0:1788869782.105661:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788869782.105668:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:17157:x1875765554748544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788869782.105690:0:17153:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788869782.105713:0:17153:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788869782.105717:0:17153:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788869782.105789:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:17157:x1875765554748544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869782.105794:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788869782.105816:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554748544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788869782.105844:0:17157:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788869782.105848:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99fe823c0c00/0xbead52e175fc3dfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3e02 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869782.105854:0:17157:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99fe823c0c00/0xbead52e175fc3dfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3e02 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869782.360442:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788869782.745119:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788869782.808319:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84e423c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788869783.385411:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869783.834366:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84e423c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788869784.414460:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788869784.721978:0:17444:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788869784.859067:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84e423c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788869785.436634:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788869785.709973:0:17496:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788869785.710173:0:17496:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788869785.889296:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84e423c0 going to sleep for 0 seconds 00000100:00080000:2.0:1788869786.009405:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788869786.009411:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788869786.009415:0:37:0:(import.c:65:import_set_state_nolock()) ffff99ffbbf31000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869786.009424:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 398 00000100:00080000:2.0:1788869786.009429:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788869786.009436:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99ffbbf31000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788869786.009458:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe84018700 x1875765554748800/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869786.009486:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869786.009489:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788869786.009492:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869786.009495:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788869786.009498:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788869786.009501:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788869786.009502:0:37:0:(import.c:65:import_set_state_nolock()) ffff99fe83861000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869786.009507:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99fe83861000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788869786.009520:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe8401a300 x1875765554748928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788869786.009683:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3618:1875765554748672:0@lo:400:kworker.0 00000100:00100000:0.0:1788869786.009755:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869786.009820:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554748800:0@lo:38:kworker.0 00000100:00100000:0.0:1788869786.009842:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869786.009856:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875765554748928:0@lo:38:kworker.0 00000100:00100000:0.0:1788869786.009873:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869786.009906:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554748672 00000100:00100000:0.0:1788869786.009913:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554748672 00000100:00100000:0.0:1788869786.009971:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869786.009979:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:3618:x1875765554748672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869786.010017:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:3618:x1875765554748672:12345-0@lo:400:kworker.0 Request processed in 40us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869786.010023:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869786.010069:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554748800 00000100:00100000:0.0:1788869786.010072:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554748800 00000100:00100000:0.0:1788869786.010085:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869786.010088:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3615:x1875765554748800:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788869786.010101:0:17166:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788869786.011661:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554748928 00000100:00100000:1.0:1788869786.011671:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554748928 00000100:00100000:1.0:1788869786.011701:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869786.011706:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1875765554748928:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788869786.011730:0:17162:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 403 last 0 00000020:00000080:1.0:1788869786.011831:0:17162:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbead52e175fc3e09 00000004:00100000:1.0:1788869786.011849:0:17162:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788869786.012914:0:17162:0:(import.c:65:import_set_state_nolock()) ffff99ffc10cc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869786.013319:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875765554748928:12345-0@lo:38:kworker.0 Request processed in 1609us (3442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869786.013329:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869786.015173:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3618:1875765554748672:0@lo:400:kworker.0 00010000:00080000:3.0:1788869786.024386:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99fe8401a300 x1875765554748928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788869786.024408:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788869786.024417:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788869786.024423:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788869786.024426:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99fe83861000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788869786.024433:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875765554748928:0@lo:38:kworker.0 00000100:00100000:0.0:1788869786.032549:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3615:x1875765554748800:12345-0@lo:38:kworker.0 Request processed in 22448us (22695us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788869786.032564:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788869786.033113:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffbbf31000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788869786.033131:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788869786.033135:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554748800:0@lo:38:kworker.0 00010000:00010000:2.0:1788869786.456585:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788869786.671563:0:17547:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788869786.671750:0:17547:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788869786.906129:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84e423c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788869787.482136:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869787.928388:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84e423c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788869788.504470:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869788.952369:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84e423c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788869789.530942:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869789.976396:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84e423c0 going to sleep for 0 seconds 00000100:00100000:1.0:1788869790.106304:0:3615:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869780/real 1788869780] req@ffff99fe839bce00 x1875765554745856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869790 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869790.106341:0:3615:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99fe839bce00 x1875765554745856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869790 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869790.106353:0:3615:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869780/real 1788869780] req@ffff99ffbfb1c700 x1875765554745728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869790 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869790.106366:0:3615:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99ffbfb1c700 x1875765554745728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869790 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788869790.106384:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffb89f1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788869790.106429:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788869790.106434:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554745856:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788869790.106440:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffae5cb800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788869790.106446:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788869790.106449:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554745728:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788869790.106941:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788869790.106949:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788869790.106954:0:37:0:(import.c:65:import_set_state_nolock()) ffff99ffbbf31000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869790.106962:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 403 00000100:00080000:3.0:1788869790.106968:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788869790.106987:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99ffbbf31000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788869790.107018:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffae6adc00 x1875765554749184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869790.107036:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869790.107039:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788869790.107042:0:37:0:(import.c:65:import_set_state_nolock()) ffff99ffae5cb800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869790.107046:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 398 00000100:00080000:3.0:1788869790.107049:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788869790.107053:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ffae5cb800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788869790.107067:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffae6ac000 x1875765554749312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869790.107075:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869790.107078:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788869790.107092:0:37:0:(import.c:65:import_set_state_nolock()) ffff99ffb89f1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869790.107098:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 398 00000100:00080000:3.0:1788869790.107101:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788869790.107106:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ffb89f1000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788869790.107128:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffae6ac700 x1875765554749440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869790.107169:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869790.107199:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3618:1875765554749056:0@lo:400:kworker.0 00000100:00100000:3.0:1788869790.107317:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869790.107374:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554749568:0@lo:400:kworker.0 00000100:00100000:3.0:1788869790.107397:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869790.108036:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554749056 00000100:00100000:3.0:1788869790.108048:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554749056 00000100:00100000:3.0:1788869790.108112:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788869790.108123:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:3618:x1875765554749056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869790.108223:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:3618:x1875765554749056:12345-0@lo:400:kworker.0 Request processed in 101us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869790.108293:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3618:1875765554749056:0@lo:400:kworker.0 00000100:00100000:3.0:1788869790.109078:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788869790.109379:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554749568 00000100:00100000:1.0:1788869790.109388:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554749568 00000100:00100000:1.0:1788869790.109439:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869790.109448:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554749568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869790.109531:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554749568:12345-0@lo:400:kworker.0 Request processed in 84us (2132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869790.109539:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869790.109571:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554749184:0@lo:38:kworker.0 00000100:00100000:1.0:1788869790.109604:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869790.109628:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554749312:0@lo:8:kworker.0 00000400:00000100:1.0:1788869790.109652:0:3615:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765554749312 offset 0 length 520: 4 00000100:00100000:1.0:1788869790.109673:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554749440:0@lo:8:kworker.0 00000400:00000100:1.0:1788869790.109689:0:3615:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765554749440 offset 0 length 520: 4 00000100:00100000:1.0:1788869790.109715:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554749184 00000100:00100000:1.0:1788869790.109719:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554749184 00000100:00100000:1.0:1788869790.109740:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869790.109745:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3615:x1875765554749184:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788869790.109765:0:17165:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1788869790.109811:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99ffae6af100 x1875765554749568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869790.109826:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554749568:0@lo:400:kworker.0 00000100:00100000:1.0:1788869790.140095:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3615:x1875765554749184:12345-0@lo:38:kworker.0 Request processed in 30334us (30475us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788869790.140116:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788869790.142322:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffbbf31000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869790.142337:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788869790.142342:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554749184:0@lo:38:kworker.0 00010000:00010000:3.0:1788869790.557290:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869791.003136:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84e423c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788869791.576455:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869792.024385:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84e423c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788869792.602011:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788869792.984878:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788869793.048457:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84e423c0 going to sleep for 0 seconds 00000020:01000004:3.0:1788869793.479578:0:17892:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788869793.479586:0:17892:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788869793.479587:0:17892:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788869793.479696:0:17892:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99ffbf9b2000 00000020:01000004:3.0:1788869793.479712:0:17892:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788869793.479725:0:17892:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788869793.479739:0:17892:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff99ffbf90cd40) 00000020:00000080:3.0:1788869793.480025:0:17892:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788869793.565192:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1788869793.565458:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788869793.568245:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1788869793.569891:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788869793.572602:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788869793.573035:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788869793.573482:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788869793.573682:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788869793.575422:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788869793.575733:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788869793.576025:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788869793.576585:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788869793.576857:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788869793.577421:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788869793.577628:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788869793.577891:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788869793.578525:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788869793.578849:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788869793.579348:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788869793.579573:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788869793.579731:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788869793.580001:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788869793.580391:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788869793.580590:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788869793.580743:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788869793.581361:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788869793.581897:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788869793.582507:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788869793.582707:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788869793.583027:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788869793.583466:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788869793.583678:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788869793.583956:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788869793.584429:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788869793.584959:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788869793.585434:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788869793.585864:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788869793.586085:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788869793.586744:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788869793.587079:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788869793.587583:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788869793.587841:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788869793.588032:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788869793.588573:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788869793.588875:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788869793.589656:0:17892:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1788869793.592865:0:17892:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788869793.593691:0:17892:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788869793.593705:0:17892:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788869793.593867:0:17892:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbead52e175fc3e17 00000020:01000004:3.0:1788869793.593876:0:17892:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788869793.593898:0:17892:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.130@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788869793.593902:0:17892:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788869793.593917:0:17892:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788869793.593962:0:17892:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788869793.593966:0:17892:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788869793.600841:0:17892:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788869793.600887:0:17892:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.130@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788869793.600892:0:17892:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788869793.600893:0:17892:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788869793.600894:0:17892:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869793.600895:0:17892:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869793.600897:0:17892:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869793.600898:0:17892:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869793.600899:0:17892:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788869793.600902:0:17892:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869793.600903:0:17892:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788869793.600907:0:17892:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788869793.600920:0:17892:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788869793.600922:0:17892:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788869793.600923:0:17892:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869793.600924:0:17892:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869793.600926:0:17892:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869793.600927:0:17892:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869793.600928:0:17892:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788869793.600929:0:17892:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869793.600930:0:17892:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788869793.600960:0:17892:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788869793.600988:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554749696:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788869793.601084:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869793.605363:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff892a33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869793.605791:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554749696 00000100:00100000:1.0:1788869793.605802:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554749696 00000100:00100000:1.0:1788869793.605866:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788869793.605876:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:17892:x1875765554749696:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788869793.605928:0:17154:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788869793.605932:0:17154:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1788869793.605940:0:17154:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788869793.606593:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:17892:x1875765554749696:12345-0@lo:253:mount.lustre.0 Request processed in 716us (5507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869793.606601:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788869793.606692:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554749696:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788869793.606707:0:17892:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788869793.606710:0:17892:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788869793.606712:0:17892:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788869793.606713:0:17892:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869793.606714:0:17892:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869793.606715:0:17892:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869793.606716:0:17892:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869793.606718:0:17892:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788869793.606719:0:17892:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869793.606720:0:17892:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788869793.606739:0:17892:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ffbf9b2000 from lustre-MDT0001 10000000:01000000:3.0:1788869793.606784:0:17892:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788869793.606788:0:17892:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788869793.606794:0:17892:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99ffbf908000 local copy 00010000:00010000:3.0:1788869793.606805:0:17892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99fe823c0800/0xbead52e175fc3d0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3d14 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869793.606907:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554749824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869793.606955:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869793.606993:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99b80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869793.607230:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554749824 00000100:00100000:0.0:1788869793.607237:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554749824 00000100:00100000:0.0:1788869793.607306:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788869793.607316:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:17892:x1875765554749824:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869793.607391:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:17892:x1875765554749824:12345-0@lo:501:mount.lustre.0 Request processed in 77us (434us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788869793.607398:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788869793.607602:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554749824:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788869793.607617:0:17892:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788869793.607637:0:17892:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788869793.607643:0:17892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99fe823c0800/0xbead52e175fc3d0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3d14 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869793.607670:0:17892:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99fe823c0800/0xbead52e175fc3d0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3d14 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869793.607695:0:17892:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ffbf9b2000 10000000:01000000:3.0:1788869793.607701:0:17892:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788869793.607706:0:17892:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99ffbf908000 10000000:01000000:3.0:1788869793.607709:0:17892:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788869793.607712:0:17892:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff99ffbf908000 from 1 10000000:01000000:3.0:1788869793.607715:0:17892:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788869793.607740:0:17892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc3e1e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869793.607761:0:17892:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc3e1e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869793.607771:0:17892:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc3e1e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869793.607787:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554749952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788869793.607813:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869793.607970:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99b80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869793.608225:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554749952 00000100:00100000:1.0:1788869793.608231:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554749952 00000100:00100000:1.0:1788869793.608432:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788869793.608443:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+12:17892:x1875765554749952:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869793.608461:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869793.608478:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff80031400/0xbead52e175fc3e25 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc3e1e expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869793.608501:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff80031400/0xbead52e175fc3e25 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc3e1e expref: 13 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869793.608512:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff80031400/0xbead52e175fc3e25 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3e1e expref: 13 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869793.608522:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80031400, rc 0) 00000100:00100000:1.0:1788869793.608566:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+13:17892:x1875765554749952:12345-0@lo:101:mount.lustre.0 Request processed in 126us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869793.608573:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788869793.608634:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554749952:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869793.608648:0:17892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc3e1e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3e25 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869793.608658:0:17892:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc3e1e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc3e25 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869793.608687:0:17892:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788869793.608705:0:17892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc3e1e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3e25 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869793.608712:0:17892:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fa00/0xbead52e175fc3e1e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3e25 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869793.608721:0:17892:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99ffbf9b2000 10000000:01000000:3.0:1788869793.608724:0:17892:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788869793.608728:0:17892:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99ffbf9b2000 from 1 10000000:01000000:3.0:1788869793.608730:0:17892:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788869793.608757:0:17892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f600/0xbead52e175fc3e2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869793.608764:0:17892:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f600/0xbead52e175fc3e2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869793.608772:0:17892:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f600/0xbead52e175fc3e2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869793.608785:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554750080:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788869793.608811:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869793.609043:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99b80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869793.609240:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554750080 00000100:00100000:0.0:1788869793.609245:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554750080 00000100:00100000:0.0:1788869793.609297:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788869793.609304:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffa00a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+13:17892:x1875765554750080:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869793.609312:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869793.609323:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffbfb05000/0xbead52e175fc3e33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc3e2c expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.609340:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffbfb05000/0xbead52e175fc3e33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc3e2c expref: 14 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.609357:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffbfb05000/0xbead52e175fc3e33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3e2c expref: 14 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.609364:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb05000, rc 0) 00000100:00100000:0.0:1788869793.609401:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffa00a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+14:17892:x1875765554750080:12345-0@lo:101:mount.lustre.0 Request processed in 97us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869793.609408:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788869793.609509:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554750080:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869793.609521:0:17892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f600/0xbead52e175fc3e2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3e33 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869793.609530:0:17892:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f600/0xbead52e175fc3e2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc3e33 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869793.609548:0:17892:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788869793.609566:0:17892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f600/0xbead52e175fc3e2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3e33 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869793.609574:0:17892:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f600/0xbead52e175fc3e2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3e33 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869793.609579:0:17892:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788869793.609583:0:17892:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788869793.609587:0:17892:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99ffbf9b2000 10000000:01000000:3.0:1788869793.609590:0:17892:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788869793.609592:0:17892:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788869793.609595:0:17892:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788869793.609610:0:17892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc3e3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869793.609617:0:17892:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc3e3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869793.609624:0:17892:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc3e3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869793.609637:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554750208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788869793.609664:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869793.609677:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99b80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869793.609731:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554750208 00000100:00100000:0.0:1788869793.609735:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554750208 00000100:00100000:0.0:1788869793.609765:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788869793.609772:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffa00a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+14:17892:x1875765554750208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869793.609779:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869793.609787:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffbfb04600/0xbead52e175fc3e41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc3e3a expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.609800:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffbfb04600/0xbead52e175fc3e41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc3e3a expref: 15 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.609808:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffbfb04600/0xbead52e175fc3e41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3e3a expref: 15 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.609814:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04600, rc 0) 00000100:00100000:0.0:1788869793.609850:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffa00a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+15:17892:x1875765554750208:12345-0@lo:101:mount.lustre.0 Request processed in 79us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869793.609855:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788869793.610041:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554750208:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869793.610066:0:17892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc3e3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3e41 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869793.610081:0:17892:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc3e3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc3e41 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788869793.611604:0:17892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1788869793.612409:0:17892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788869793.619423:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788869793.619482:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788869793.619500:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788869793.619512:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788869793.619524:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1788869793.619535:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1788869793.619551:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1788869793.619563:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788869793.619575:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788869793.619586:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1788869793.619598:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1788869793.619615:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1788869793.619627:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1788869793.619640:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788869793.619654:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788869793.619668:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1788869793.619680:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788869793.619693:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788869793.619706:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1788869793.619720:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788869793.619733:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788869793.619751:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788869793.619766:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788869793.619793:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1788869793.619799:0:17892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1788869793.619906:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554750336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869793.620374:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869793.621613:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554750336 00000100:00100000:2.0:1788869793.621624:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554750336 00000100:00100000:2.0:1788869793.621839:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788869793.621850:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffa00a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+15:17892:x1875765554750336:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869793.622079:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffa00a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+15:17892:x1875765554750336:12345-0@lo:501:mount.lustre.0 Request processed in 231us (1706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869793.622285:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788869793.623702:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99b83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869793.623742:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554750336:0@lo:501:mount.lustre.0 00010000:00010000:2.0:1788869793.624506:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869793.625040:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554750464:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869793.625132:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869793.625447:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99b83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869793.625532:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554750464 00000100:00100000:2.0:1788869793.625538:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554750464 00000100:00100000:0.0:1788869793.625708:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788869793.625718:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+15:17892:x1875765554750464:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869793.626998:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+15:17892:x1875765554750464:12345-0@lo:503:mount.lustre.0 Request processed in 1275us (1860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869793.627009:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788869793.627278:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554750464:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788869793.627712:0:17892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788869793.627814:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554750592:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869793.627864:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869793.627893:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99b80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869793.628023:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554750592 00000100:00100000:1.0:1788869793.628029:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554750592 00000100:00100000:1.0:1788869793.628076:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788869793.628085:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+15:17892:x1875765554750592:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869793.629091:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+15:17892:x1875765554750592:12345-0@lo:502:mount.lustre.0 Request processed in 1004us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869793.629101:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788869793.629363:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554750592:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788869793.629563:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788869793.629592:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1788869793.629605:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1788869793.629619:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1788869793.629633:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1788869793.629647:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1788869793.629661:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1788869793.629673:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1788869793.629685:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1788869793.629698:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1788869793.629711:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1788869793.629724:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1788869793.629736:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1788869793.633351:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1788869793.633410:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1788869793.633445:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1788869793.633457:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1788869793.633470:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1788869793.633481:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1788869793.633493:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1788869793.633504:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1788869793.633516:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1788869793.633528:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1788869793.633541:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1788869793.633554:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1788869793.633565:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1788869793.633577:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1788869793.633589:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1788869793.633601:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1788869793.633613:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1788869793.633627:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1788869793.633639:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1788869793.633652:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1788869793.633664:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1788869793.633675:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1788869793.633688:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1788869793.633701:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1788869793.633714:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1788869793.633726:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1788869793.633739:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1788869793.633750:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1788869793.633763:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1788869793.633776:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1788869793.633789:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1788869793.633845:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554750720:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869793.634676:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869793.634771:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99b80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869793.635036:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554750720 00000100:00100000:1.0:1788869793.635044:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554750720 00000100:00100000:1.0:1788869793.635145:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788869793.635166:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+15:17892:x1875765554750720:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869793.635331:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+15:17892:x1875765554750720:12345-0@lo:502:mount.lustre.0 Request processed in 177us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869793.635349:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788869793.635678:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554750720:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788869793.635761:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1788869793.635774:0:17892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1788869793.636812:0:17896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869793.636825:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869793.636827:0:17896:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788869793.636834:0:17896:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788869793.636838:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788869793.636853:0:17896:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff99ff8b773380) 00000020:00000080:0.0:1788869793.636875:0:17896:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1788869793.636881:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788869793.637448:0:17896:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788869793.637459:0:17896:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbead52e175fc3e4f 00000020:00000080:0.0:1788869793.637689:0:17896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788869793.637695:0:17896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869793.637700:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869793.637702:0:17896:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788869793.637705:0:17896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869793.637708:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869793.637710:0:17896:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788869793.637713:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788869793.637721:0:17896:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff99ff8b7719c0) 00000020:00000080:0.0:1788869793.637732:0:17896:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1788869793.637736:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788869793.637737:0:17896:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788869793.637740:0:17896:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788869793.637756:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788869793.637800:0:17896:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffbf9b2000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788869793.637821:0:17896:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff99ffbcd119c0) 00000020:00000080:0.0:1788869793.637832:0:17896:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1788869793.637895:0:17896:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788869793.637905:0:17896:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbead52e175fc3e64 00000020:00000080:0.0:1788869793.638139:0:17896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788869793.638147:0:17896:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788869793.638220:0:17896:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xbead52e175fc3e6b 00080000:01000000:0.0:1788869793.638228:0:17896:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788869793.638233:0:17896:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbead52e175fc3e72 00010000:00010000:1.0:1788869793.694094:0:17896:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1788869793.694769:0:17896:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:1.0:1788869793.695058:0:17896:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788869793.701819:0:17896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788869793.701833:0:17896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869793.701840:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869793.701842:0:17896:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788869793.701846:0:17896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869793.701852:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869793.701854:0:17896:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788869793.701857:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788869793.701862:0:17896:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:00000080:3.0:1788869793.701890:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788869793.701989:0:17896:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff99ffbaf419c0) 00000020:00000080:3.0:1788869793.702016:0:17896:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788869793.702024:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788869793.702098:0:17896:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788869793.702104:0:17896:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788869793.702120:0:17896:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbead52e175fc3e80 00010000:00080000:3.0:1788869793.702152:0:17896:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ff89bae800@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.130@tcp at head 00010000:00010000:3.0:1788869793.705796:0:17896:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1788869793.706620:0:17896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788869793.706635:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788869793.706683:0:17896:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788869793.706708:0:17896:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbead52e175fc3e87 00000100:00080000:1.0:1788869793.706719:0:17896:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788869793.706724:0:17896:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99ff89bae800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1788869793.706758:0:17896:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffbfb1f100 x1875765554750848/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788869793.706779:0:17896:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1788869793.706879:0:17896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869793.706883:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869793.706885:0:17896:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788869793.706888:0:17896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788869793.706891:0:17896:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788869793.706892:0:17896:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788869793.706894:0:17896:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788869793.706895:0:17896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788869793.706898:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869793.706899:0:17896:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788869793.706901:0:17896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869793.706905:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869793.706917:0:17896:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788869793.706921:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788869793.706952:0:17896:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788869793.706966:0:17896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869793.706975:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869793.706977:0:17896:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788869793.706980:0:17896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788869793.706982:0:17896:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1788869793.706983:0:17896:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788869793.706984:0:17896:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788869793.706986:0:17896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788869793.706988:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869793.706989:0:17896:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788869793.706991:0:17896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788869793.706995:0:17896:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788869793.706998:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869793.706999:0:17896:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788869793.707003:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788869793.707006:0:17896:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:1.0:1788869793.707028:0:17896:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788869793.707031:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788869793.707042:0:17896:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff99fe82cdb380) 00000020:00000080:1.0:1788869793.707054:0:17896:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788869793.707059:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788869793.707119:0:17896:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788869793.707126:0:17896:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788869793.707133:0:17896:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbead52e175fc3e95 00010000:00080000:1.0:1788869793.707166:0:17896:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fe83b0c000@lustre-OST0000-osc-MDT0001: add connection 192.168.201.130@tcp at head 00010000:00010000:1.0:1788869793.707391:0:17896:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1788869793.707870:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554750848:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788869793.707954:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869793.708139:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554750848 00000100:00100000:1.0:1788869793.708147:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554750848 00000100:00100000:1.0:1788869793.708183:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869793.708190:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3615:x1875765554750848:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788869793.708214:0:17166:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:1.0:1788869793.708245:0:17166:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbead52e175fc3e9c 00000004:00100000:1.0:1788869793.708291:0:17166:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788869793.708297:0:17166:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:2.0:1788869793.708749:0:17896:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788869793.708971:0:17896:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1788869793.710207:0:14945:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788869793.710213:0:14945:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788869793.710217:0:14945:0:(import.c:65:import_set_state_nolock()) ffff99ffbbf31000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869793.710223:0:14945:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 408 00000100:00080000:3.0:1788869793.710230:0:14945:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788869793.710235:0:14945:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99ffbbf31000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788869793.710279:0:14945:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffae6af100 x1875765554750976/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869793.710311:0:14945:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869793.710314:0:14945:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869793.710317:0:14945:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869793.710320:0:14945:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788869793.710427:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875765554751104:0@lo:400:kworker.0 00000100:00100000:3.0:1788869793.710484:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869793.710536:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554751104 00000100:00100000:3.0:1788869793.710542:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554751104 00000100:00100000:3.0:1788869793.710584:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869793.710592:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875765554751104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869793.710638:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875765554751104:12345-0@lo:400:kworker.0 Request processed in 47us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869793.710645:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788869793.710680:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99ffae6ace00 x1875765554751104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869793.710693:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875765554751104:0@lo:400:kworker.0 00000100:00100000:3.0:1788869793.710715:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554750976:0@lo:38:kworker.0 00000100:00100000:3.0:1788869793.710737:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869793.710769:0:17165:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788869793.710776:0:17165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000040:00080000:2.0:1788869793.711137:0:17896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869793.711450:0:17896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788869793.711588:0:17896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:2.0:1788869793.712241:0:17902:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788869793.712245:0:17902:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788869793.712847:0:17896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788869793.712858:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788869793.712894:0:17896:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788869793.712927:0:17896:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbead52e175fc3ea3 00000100:00080000:2.0:1788869793.712936:0:17896:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869793.712948:0:17896:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99fe83b0c000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788869793.712978:0:17896:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe84018380 x1875765554751232/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869793.713003:0:17896:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788869793.713050:0:17896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869793.713054:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869793.713056:0:17896:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788869793.713059:0:17896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788869793.713062:0:17896:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788869793.713064:0:17896:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788869793.713066:0:17896:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788869793.713067:0:17896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788869793.713070:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869793.713072:0:17896:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788869793.713074:0:17896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788869793.713078:0:17896:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788869793.713081:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869793.713082:0:17896:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788869793.713085:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788869793.713089:0:17896:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:2.0:1788869793.713123:0:17896:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788869793.713127:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788869793.713139:0:17896:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff99ffb98199c0) 00000020:00000080:2.0:1788869793.713153:0:17896:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788869793.713158:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788869793.713212:0:17896:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788869793.713218:0:17896:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788869793.713223:0:17896:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbead52e175fc3eb1 00010000:00080000:2.0:1788869793.713274:0:17896:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ff87c82800@lustre-OST0001-osc-MDT0001: add connection 192.168.201.130@tcp at head 00000100:00100000:3.0:1788869793.713619:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554751232:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788869793.713670:0:3615:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765554751232 offset 0 length 520: 4 00000100:00080000:3.0:1788869793.713723:0:14945:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869793.713734:0:14945:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869793.713736:0:14945:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869793.713738:0:14945:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788869793.713987:0:17896:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788869793.714056:0:17896:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788869793.714078:0:17896:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1788869793.715124:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554750976 00000100:00100000:3.0:1788869793.715133:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554750976 00000100:00100000:0.0:1788869793.715689:0:17901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788869793.715698:0:17901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3615:x1875765554750976:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788869793.715796:0:17901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3615:x1875765554750976:12345-0@lo:38:kworker.0 Request processed in 98us (5057us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788869793.715803:0:17901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788869793.715846:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788869793.715855:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffbbf31000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869793.715859:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788869793.715863:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554750976:0@lo:38:kworker.0 00000040:00080000:2.0:1788869793.717890:0:17896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869793.719470:0:17896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788869793.719715:0:17896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00080000:1.0:1788869793.720343:0:17166:0:(import.c:65:import_set_state_nolock()) ffff99ffae5d4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869793.720445:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3615:x1875765554750848:12345-0@lo:38:llog_process_th.0 Request processed in 12252us (12489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869793.720457:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869793.720691:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788869793.720700:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788869793.720709:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788869793.720715:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788869793.720718:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ff89bae800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788869793.720739:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554750848:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788869793.720883:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554751360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869793.720934:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869793.721191:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554751360 00000100:00100000:2.0:1788869793.721197:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554751360 00000100:00100000:2.0:1788869793.721243:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869793.721274:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1875765554751360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869793.721302:0:17165:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788869793.721342:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1875765554751360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869793.721349:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788869793.721509:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554751360:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788869793.721811:0:17904:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788869793.721816:0:17904:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788869793.722741:0:17896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788869793.722754:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788869793.722795:0:17896:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788869793.722819:0:17896:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbead52e175fc3eb8 00000100:00080000:2.0:1788869793.722829:0:17896:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869793.722834:0:17896:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99ff87c82800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788869793.722861:0:17896:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe8401a300 x1875765554751488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869793.722929:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554751488:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788869793.722969:0:3615:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765554751488 offset 0 length 520: 4 00000100:00080000:2.0:1788869793.723015:0:17896:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788869793.723080:0:17896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869793.723368:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869793.723371:0:17896:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788869793.723377:0:17896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869793.723382:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869793.723384:0:17896:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788869793.723388:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788869793.723390:0:17896:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788869793.723392:0:17896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869793.723404:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869793.723406:0:17896:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788869793.723410:0:17896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869793.723412:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869793.723414:0:17896:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788869793.723419:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788869793.723447:0:17896:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869793.723450:0:17896:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869793.723452:0:17896:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788869793.723455:0:17896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:0.0:1788869793.723686:0:14945:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869793.723691:0:14945:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869793.723694:0:14945:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869793.723697:0:14945:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1788869793.723761:0:17892:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788869793.723793:0:17892:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788869793.723843:0:17892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc3e3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3e41 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869793.723855:0:17892:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9ea00/0xbead52e175fc3e3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3e41 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869793.723863:0:17892:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ffbf9b2000 from 1 10000000:01000000:3.0:1788869793.723872:0:17892:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788869793.723897:0:17892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3ebf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869793.723905:0:17892:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3ebf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869793.723985:0:17892:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3ebf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869793.724005:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554751616:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788869793.724183:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869793.724211:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99b8600 going to sleep for 11 seconds 00000100:00100000:2.0:1788869793.724368:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554751616 00000100:00100000:2.0:1788869793.724375:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554751616 00000100:00100000:2.0:1788869793.724422:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788869793.724431:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+15:17892:x1875765554751616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869793.724443:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869793.724455:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fe823c0a00/0xbead52e175fc3ec6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc3ebf expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869793.724475:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fe823c0a00/0xbead52e175fc3ec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc3ebf expref: 16 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869793.724485:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fe823c0a00/0xbead52e175fc3ec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3ebf expref: 16 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869793.724493:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0a00, rc 0) 00000100:00100000:2.0:1788869793.724601:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+16:17892:x1875765554751616:12345-0@lo:101:mount.lustre.0 Request processed in 171us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869793.724608:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788869793.724715:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554751616:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869793.724730:0:17892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3ebf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3ec6 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869793.724740:0:17892:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3ebf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc3ec6 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869793.725722:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554751744:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788869793.725772:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869793.725837:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99b8600 going to sleep for 11 seconds 00000100:00100000:2.0:1788869793.726026:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554751744 00000100:00100000:2.0:1788869793.726032:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554751744 00000100:00100000:2.0:1788869793.726248:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788869793.726292:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+16:17892:x1875765554751744:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788869793.726314:0:17155:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788869793.726331:0:17155:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788869793.726334:0:17155:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788869793.726426:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+16:17892:x1875765554751744:12345-0@lo:256:mount.lustre.0 Request processed in 135us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869793.726433:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788869793.726505:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554751744:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788869793.727097:0:17892:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788869793.727122:0:17892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3ebf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3ec6 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869793.727145:0:17892:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3ebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3ec6 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869793.727153:0:17892:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ffbf9b2000 from 1 10000000:01000000:3.0:1788869793.727156:0:17892:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788869793.727183:0:17892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc3ecd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869793.727191:0:17892:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc3ecd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869793.727201:0:17892:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc3ecd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869793.727218:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554751872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788869793.727283:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869793.727781:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99b8600 going to sleep for 11 seconds 00000100:00100000:1.0:1788869793.727861:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554751872 00000100:00100000:1.0:1788869793.727868:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554751872 00000100:00100000:1.0:1788869793.727902:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788869793.727973:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+16:17892:x1875765554751872:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869793.727986:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869793.728001:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff80031000/0xbead52e175fc3ed4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc3ecd expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869793.728027:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff80031000/0xbead52e175fc3ed4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc3ecd expref: 17 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869793.728037:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff80031000/0xbead52e175fc3ed4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3ecd expref: 17 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869793.728179:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80031000, rc 0) 00000100:00100000:1.0:1788869793.728317:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+17:17892:x1875765554751872:12345-0@lo:101:mount.lustre.0 Request processed in 346us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869793.728324:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788869793.728454:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554751872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869793.728470:0:17892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc3ecd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3ed4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869793.728478:0:17892:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc3ecd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc3ed4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788869793.728620:0:17892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788869793.728651:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554752000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869793.728679:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869793.728721:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99b8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869793.728847:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554752000 00000100:00100000:1.0:1788869793.728852:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554752000 00000100:00100000:1.0:1788869793.728885:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788869793.728892:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+17:17892:x1875765554752000:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869793.729208:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+17:17892:x1875765554752000:12345-0@lo:501:mount.lustre.0 Request processed in 315us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869793.729215:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788869793.729500:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554752000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869793.729615:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554752128:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869793.729661:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869793.729692:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99b8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869793.729741:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554752128 00000100:00100000:2.0:1788869793.729746:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554752128 00000100:00100000:2.0:1788869793.729780:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788869793.729788:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+17:17892:x1875765554752128:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869793.729882:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+17:17892:x1875765554752128:12345-0@lo:503:mount.lustre.0 Request processed in 95us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869793.729889:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788869793.730082:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554752128:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788869793.730687:0:17892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788869793.730750:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554752256:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869793.730794:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869793.730865:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99b8600 going to sleep for 11 seconds 00000100:00100000:0.0:1788869793.731069:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554752256 00000100:00100000:0.0:1788869793.731075:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554752256 00000100:00100000:1.0:1788869793.731232:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788869793.731242:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+17:17892:x1875765554752256:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869793.731368:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+17:17892:x1875765554752256:12345-0@lo:502:mount.lustre.0 Request processed in 128us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869793.731375:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788869793.731486:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554752256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788869793.731663:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788869793.731690:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1788869793.731703:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1788869793.731714:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1788869793.731725:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1788869793.731739:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1788869793.731751:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1788869793.731765:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1788869793.731779:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788869793.731792:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1788869793.731804:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1788869793.731838:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554752384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869793.731876:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869793.731902:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb99b8600 going to sleep for 11 seconds 00000100:00100000:2.0:1788869793.732188:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554752384 00000100:00100000:2.0:1788869793.732193:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554752384 00000100:00100000:2.0:1788869793.732222:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788869793.732228:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+17:17892:x1875765554752384:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869793.732335:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+17:17892:x1875765554752384:12345-0@lo:502:mount.lustre.0 Request processed in 106us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869793.732341:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788869793.732618:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554752384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788869793.732665:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1788869793.732680:0:17892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788869793.733621:0:17906:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869793.733631:0:17906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869793.733634:0:17906:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788869793.733642:0:17906:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffbf9b2000 00000020:00000080:3.0:1788869793.733645:0:17906:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788869793.733653:0:17906:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869793.733656:0:17906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869793.733657:0:17906:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788869793.733659:0:17906:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869793.733662:0:17906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869793.733663:0:17906:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788869793.733666:0:17906:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffbf9b2000 00000020:00000080:3.0:1788869793.733668:0:17906:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788869793.733771:0:17906:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869793.733776:0:17906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869793.733777:0:17906:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788869793.733780:0:17906:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869793.733783:0:17906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869793.733784:0:17906:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788869793.733788:0:17906:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ffbf9b2000 00000020:00000080:3.0:1788869793.733790:0:17906:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788869793.736033:0:17906:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869793.736045:0:17906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869793.736047:0:17906:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788869793.736052:0:17906:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869793.736055:0:17906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869793.736056:0:17906:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788869793.736061:0:17906:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ffbf9b2000 00000020:00000080:3.0:1788869793.736063:0:17906:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788869793.736156:0:17906:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869793.736160:0:17906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869793.736161:0:17906:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788869793.736165:0:17906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1788869793.741478:0:17892:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788869793.741532:0:17892:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869793.741555:0:17892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc3ecd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3ed4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869793.741567:0:17892:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc3ecd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3ed4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869793.741622:0:17892:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788869793.741624:0:17892:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ffbf9b2000 10000000:01000000:1.0:1788869793.741627:0:17892:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ffbf9b2000 10000000:01000000:1.0:1788869793.741632:0:17892:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788869793.741638:0:17892:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ffbf9b2000 from 1 10000000:01000000:1.0:1788869793.741640:0:17892:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788869793.741679:0:17892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff80030400/0xbead52e175fc3edb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869793.741689:0:17892:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ff80030400/0xbead52e175fc3edb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869793.741716:0:17892:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ff80030400/0xbead52e175fc3edb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869793.741742:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554752512:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788869793.741814:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869793.741857:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869793.745694:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554752512 00000100:00100000:3.0:1788869793.745709:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554752512 00000100:00100000:3.0:1788869793.745763:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788869793.745772:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+17:17892:x1875765554752512:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869793.745789:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869793.745813:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc3ee2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc3edb expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869793.745843:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc3ee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc3edb expref: 18 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869793.745856:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb9a9e800/0xbead52e175fc3ee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3edb expref: 18 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869793.745865:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9e800, rc 0) 00000100:00100000:3.0:1788869793.746211:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:17892:x1875765554752512:12345-0@lo:101:mount.lustre.0 Request processed in 440us (4396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869793.746219:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788869793.746640:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554752512:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869793.746662:0:17892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ff80030400/0xbead52e175fc3edb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3ee2 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869793.746673:0:17892:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ff80030400/0xbead52e175fc3edb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc3ee2 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869793.754539:0:17892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788869793.754843:0:17892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869793.755064:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788869793.755319:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1788869793.755342:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1788869793.755357:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1788869793.755369:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1788869793.755381:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1788869793.755397:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1788869793.755407:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1788869793.755419:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1788869793.755431:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1788869793.755461:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1788869793.755476:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1788869793.755487:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1788869793.755498:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1788869793.755509:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1788869793.755585:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1788869793.755609:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1788869793.755624:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1788869793.755639:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1788869793.755652:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1788869793.755663:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1788869793.755674:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1788869793.755685:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1788869793.755698:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1788869793.755712:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1788869793.755724:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1788869793.755749:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1788869793.755766:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1788869793.755786:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1788869793.755799:0:17892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788869793.755896:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84019c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554752640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869793.756040:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869793.756213:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554752640 00000100:00100000:1.0:1788869793.756220:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554752640 00000100:00100000:1.0:1788869793.756283:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788869793.756294:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:17892:x1875765554752640:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869793.756415:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:17892:x1875765554752640:12345-0@lo:501:mount.lustre.0 Request processed in 123us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869793.756422:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788869793.757013:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae62d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869793.757043:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84019c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554752640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869793.757163:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84019c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554752768:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869793.757212:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869793.757247:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae62d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869793.757606:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554752768 00000100:00100000:3.0:1788869793.757613:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554752768 00000100:00100000:3.0:1788869793.758184:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788869793.758195:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:17892:x1875765554752768:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869793.758393:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:17892:x1875765554752768:12345-0@lo:503:mount.lustre.0 Request processed in 200us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869793.758400:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788869793.758493:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84019c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554752768:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788869793.758943:0:17892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788869793.759023:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84019c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554752896:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869793.759069:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869793.763547:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae62d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788869793.768620:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554752896 00000100:00100000:1.0:1788869793.768637:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554752896 00000100:00100000:1.0:1788869793.768713:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788869793.768723:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc21e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:17892:x1875765554752896:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869793.768898:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc21e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:17892:x1875765554752896:12345-0@lo:502:mount.lustre.0 Request processed in 178us (9829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869793.768916:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788869793.769286:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84019c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554752896:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869793.769706:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788869793.769743:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1788869793.769758:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1788869793.769772:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1788869793.769785:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1788869793.769798:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1788869793.769811:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1788869793.769825:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1788869793.769838:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1788869793.769853:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1788869793.769868:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1788869793.769898:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1788869793.770060:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1788869793.770168:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1788869793.770187:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1788869793.770200:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1788869793.770211:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1788869793.770225:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1788869793.770237:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1788869793.770249:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1788869793.770297:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1788869793.770312:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1788869793.770324:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1788869793.770338:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1788869793.770350:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1788869793.770361:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1788869793.770372:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1788869793.770396:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1788869793.770409:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1788869793.770420:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1788869793.770431:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1788869793.770442:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1788869793.770453:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1788869793.770464:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1788869793.770476:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1788869793.770487:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1788869793.770497:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1788869793.770508:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1788869793.770767:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1788869793.770788:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1788869793.770801:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1788869793.770812:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1788869793.770824:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1788869793.770849:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1788869793.770866:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1788869793.770878:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1788869793.770899:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1788869793.770983:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1788869793.771035:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84019c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554753024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869793.771575:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869793.771651:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae62d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788869793.777310:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554753024 00000100:00100000:0.0:1788869793.777330:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554753024 00000100:00100000:0.0:1788869793.777448:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788869793.777460:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc21e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:17892:x1875765554753024:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869793.777658:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc21e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:17892:x1875765554753024:12345-0@lo:502:mount.lustre.0 Request processed in 201us (6138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869793.777665:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788869793.777758:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84019c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554753024:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869793.779182:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1788869793.779228:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1788869793.779290:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84019c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554753152:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869793.779358:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869793.779681:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae62d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788869793.779737:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554753152 00000100:00100000:3.0:1788869793.779745:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554753152 00000100:00100000:3.0:1788869793.779788:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788869793.779797:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:17892:x1875765554753152:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869793.780022:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:17892:x1875765554753152:12345-0@lo:502:mount.lustre.0 Request processed in 225us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869793.780031:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788869793.783331:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84019c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554753152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869793.783458:0:17892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1788869793.783475:0:17892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788869793.791079:0:17912:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788869793.791167:0:17912:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff99ffb981b380) 00000020:00000080:2.0:1788869793.791193:0:17912:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788869793.791392:0:17912:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffbf9b2000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788869793.791397:0:17912:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffbf9b2000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788869793.791401:0:17912:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffbf9b2000 3 00010000:00080000:3.0:1788869793.795312:0:17912:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ff83fe4000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.130@tcp at head 00010000:00010000:0.0:1788869793.803697:0:17912:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1788869793.803832:0:17912:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788869793.803884:0:17912:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788869793.803898:0:17912:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xbead52e175fc3ef0 00000100:00080000:0.0:1788869793.803980:0:17912:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788869793.803988:0:17912:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99ff83fe4000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788869793.804026:0:17912:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe839bf100 x1875765554753280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869793.804100:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875765554753280:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788869793.804185:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869793.804353:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554753280 00000100:00100000:1.0:1788869793.804361:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554753280 00000100:00100000:1.0:1788869793.804399:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869793.804406:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1875765554753280:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788869793.804431:0:17162:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:1.0:1788869793.804484:0:17162:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xbead52e175fc3ef7 00000004:00100000:1.0:1788869793.804500:0:17162:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788869793.804544:0:17162:0:(import.c:65:import_set_state_nolock()) ffff99ffae5d0000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788869793.806188:0:17912:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788869793.806592:0:14945:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869793.806598:0:14945:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869793.806601:0:14945:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869793.806603:0:14945:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788869793.806759:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875765554753280:12345-0@lo:38:llog_process_th.0 Request processed in 2349us (2570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869793.806772:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:2.0:1788869793.806905:0:17912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1788869793.806998:0:17892:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788869793.807026:0:17892:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788869793.807039:0:17892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff80030400/0xbead52e175fc3edb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3ee2 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869793.807049:0:17892:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ff80030400/0xbead52e175fc3edb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3ee2 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788869793.807164:0:17892:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788869793.807166:0:17892:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788869793.807167:0:17892:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869793.807168:0:17892:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869793.807170:0:17892:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869793.807171:0:17892:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869793.807172:0:17892:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788869793.807174:0:17892:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869793.807175:0:17892:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788869793.807179:0:17892:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788869793.807181:0:17892:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788869793.807182:0:17892:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788869793.807183:0:17892:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869793.807184:0:17892:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869793.807185:0:17892:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869793.807186:0:17892:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869793.807188:0:17892:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788869793.807189:0:17892:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869793.807190:0:17892:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788869793.807211:0:17892:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788869793.807227:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84019c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554753408:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788869793.807305:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869793.807335:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae62d300 going to sleep for 11 seconds 00010000:00080000:3.0:1788869793.807490:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99fe839bf100 x1875765554753280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869793.807502:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788869793.807509:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788869793.807577:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788869793.807582:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788869793.807585:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ff83fe4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788869793.807592:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875765554753280:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788869793.807620:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554753408 00000100:00100000:3.0:1788869793.807625:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554753408 00000100:00100000:3.0:1788869793.807665:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788869793.807672:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:17892:x1875765554753408:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788869793.807694:0:17153:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788869793.807705:0:17153:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1788869793.812511:0:17140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788869793.812695:0:17153:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788869793.812739:0:17153:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788869793.813069:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:17892:x1875765554753408:12345-0@lo:253:mount.lustre.0 Request processed in 5393us (5759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869793.813082:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788869793.813201:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84019c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17892:1875765554753408:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788869793.813216:0:17892:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788869793.813219:0:17892:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788869793.813221:0:17892:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788869793.813222:0:17892:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869793.813223:0:17892:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869793.813224:0:17892:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869793.813226:0:17892:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869793.813227:0:17892:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788869793.813229:0:17892:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869793.813240:0:17892:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788869793.813285:0:17892:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788869793.815975:0:17176:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788869793.815983:0:17176:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788869793.821378:0:17176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffbfb04a00/0xbead52e175fc3efe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.821403:0:17176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffbfb04e00/0xbead52e175fc3e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3dfb expref: 17 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.821413:0:17176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fe823c0a00/0xbead52e175fc3ec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3ebf expref: 17 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.821422:0:17176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffbfb04a00/0xbead52e175fc3efe lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.821479:0:17176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fe823c0a00/0xbead52e175fc3ec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc3ebf expref: 17 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.821497:0:17176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fe823c0a00/0xbead52e175fc3ec6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc3ebf expref: 17 pid: 17154 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869793.821512:0:17176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bc000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17176:1875765554753536:0@lo:104: 00000100:00100000:0.0:1788869793.821885:0:17176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788869793.821953:0:17176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffbfb04e00/0xbead52e175fc3e02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc3dfb expref: 17 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.821962:0:17176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffbfb04e00/0xbead52e175fc3e02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc3dfb expref: 17 pid: 17154 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869793.821972:0:17176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17176:1875765554753664:0@lo:104: 00000100:00100000:0.0:1788869793.821996:0:17176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869793.822014:0:17176:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89244b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869793.822059:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554753536 00000100:00100000:0.0:1788869793.822065:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554753536 00000100:00100000:0.0:1788869793.822119:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554753664 00000100:00100000:0.0:1788869793.822123:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554753664 00000100:00100000:0.0:1788869793.822140:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869793.822148:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+4:17176:x1875765554753536:12345-0@lo:104: 00010000:00010000:0.0:1788869793.822161:0:17143:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3ebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3ec6 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.822211:0:17143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788869793.822217:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+4:17176:x1875765554753536:12345-0@lo:104: Request processed in 70us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869793.822232:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869793.822272:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869793.822280:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+3:17176:x1875765554753664:12345-0@lo:104: 00010000:00010000:0.0:1788869793.822289:0:17143:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99fe823c0c00/0xbead52e175fc3dfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3e02 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.822325:0:17143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788869793.822330:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+3:17176:x1875765554753664:12345-0@lo:104: Request processed in 52us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869793.822337:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788869793.822353:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869793.822359:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3ebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3ec6 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.822367:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9f400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:0.0:1788869793.822372:0:17149:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3ebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc3ec6 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.822380:0:17149:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc3ec6 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869793.822388:0:17149:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc3ec6 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869793.822395:0:17149:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869793.822421:0:17149:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3ebf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3ec6 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.822428:0:17149:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869793.822454:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3ebf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3ec6 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.822462:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3ebf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3ec6 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.822476:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869793.822479:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99fe823c0c00/0xbead52e175fc3dfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3e02 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.822486:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0c00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:0.0:1788869793.822489:0:17149:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99fe823c0c00/0xbead52e175fc3dfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc3e02 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.822495:0:17149:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99fe823c0c00/0xbead52e175fc3dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc3e02 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869793.822502:0:17149:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99fe823c0c00/0xbead52e175fc3dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc3e02 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869793.822508:0:17149:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869793.822753:0:17149:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99fe823c0c00/0xbead52e175fc3dfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3e02 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.822760:0:17149:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869793.822786:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99fe823c0c00/0xbead52e175fc3dfb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3e02 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.822793:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99fe823c0c00/0xbead52e175fc3dfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3e02 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.822816:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869793.822818:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869793.822820:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869793.822826:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869793.822845:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3619:1875765554753792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869793.822876:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869793.822907:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869793.822914:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3617:1875765554753920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869793.822936:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869793.822964:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554753792 00000100:00100000:0.0:1788869793.822969:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554753792 00010000:00010000:0.0:1788869793.822986:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fe823c0a00/0xbead52e175fc3ec6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3ebf expref: 18 pid: 17154 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869793.823005:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554753920 00000100:00100000:0.0:1788869793.823008:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554753920 00010000:00010000:0.0:1788869793.823019:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffbfb04e00/0xbead52e175fc3e02 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3dfb expref: 19 pid: 17154 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869793.823031:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869793.823038:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+19:3619:x1875765554753792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869793.823050:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869793.823055:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fe823c0a00/0xbead52e175fc3ec6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3ebf expref: 19 pid: 17154 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.823065:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fe823c0a00/0xbead52e175fc3ec6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc3ebf expref: 19 pid: 17154 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.823091:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869793.823136:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+19:3619:x1875765554753792:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869793.823143:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869793.823157:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869793.823163:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:3617:x1875765554753920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869793.823172:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869793.823176:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffbfb04e00/0xbead52e175fc3e02 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3dfb expref: 18 pid: 17154 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.823185:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffbfb04e00/0xbead52e175fc3e02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc3dfb expref: 18 pid: 17154 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.823197:0:17145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffbfb04a00/0xbead52e175fc3efe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.823206:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffbfb04a00/0xbead52e175fc3efe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788869793.823219:0:17145:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007236943s 00010000:00010000:0.0:1788869793.823224:0:17145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffbfb04a00/0xbead52e175fc3efe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.823231:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffbfb04a00/0xbead52e175fc3efe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.823238:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffbfb04a00/0xbead52e175fc3efe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.823304:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffbfb04a00/0xbead52e175fc3efe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.823310:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04a00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869793.823314:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffbfb04a00/0xbead52e175fc3efe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.823322:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffbfb04a00/0xbead52e175fc3efe lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.823332:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffbfb04a00/0xbead52e175fc3efe lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.823341:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869793.823370:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:3617:x1875765554753920:12345-0@lo:103:ldlm_bl.0 Request processed in 207us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869793.823377:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869793.823412:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3619:1875765554753792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869793.823436:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3617:1875765554753920:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869793.823454:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fe823c0a00/0xbead52e175fc3ec6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc3ebf expref: 17 pid: 17154 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869793.823465:0:17176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bc000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17176:1875765554753536:0@lo:104: 00010000:00010000:0.0:1788869793.823475:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffbfb04e00/0xbead52e175fc3e02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc3dfb expref: 16 pid: 17154 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869793.823483:0:17176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17176:1875765554753664:0@lo:104: 00010000:00010000:0.0:1788869793.823503:0:17176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffbfb04a00/0xbead52e175fc3efe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.823512:0:17176:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffbfb04a00/0xbead52e175fc3efe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.824022:0:17176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffbfb04a00/0xbead52e175fc3efe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869793.824029:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffbfb04a00/0xbead52e175fc3efe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1788869793.825936:0:17892:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1788869793.827429:0:17918:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1788869793.828022:0:17918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788869793.830621:0:17892:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:01000000:0.0:1788869793.831286:0:17892:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788869793.831331:0:17892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788869793.831798:0:17892:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788869793.831807:0:17892:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788869793.831841:0:17892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788869793.832063:0:17919:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17919:1875765554754048:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788869793.833220:0:17919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869793.833279:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554754048 00000100:00100000:3.0:1788869793.833287:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554754048 00000100:00100000:3.0:1788869793.833332:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788869793.833340:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17919:x1875765554754048:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788869793.833402:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17919:x1875765554754048:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 63us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869793.833409:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788869793.833430:0:17919:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b669c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869793.833451:0:17919:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17919:1875765554754048:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788869793.833475:0:17919:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788869793.833503:0:17919:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17919:1875765554754176:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788869793.833529:0:17919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869793.833546:0:17901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554754176 00000100:00100000:3.0:1788869793.833549:0:17901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554754176 00000100:00100000:3.0:1788869793.833566:0:17901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788869793.833570:0:17901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17919:x1875765554754176:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788869793.833676:0:17901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17919:x1875765554754176:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 105us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869793.833683:0:17901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788869793.833700:0:17919:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b669c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869793.833713:0:17919:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17919:1875765554754176:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788869793.833766:0:17919:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17919:1875765554754304:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788869793.833800:0:17919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869793.833814:0:17919:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b66180 going to sleep for 11 seconds 00000020:00080000:1.0:1788869793.834208:0:17917:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788869793.834213:0:17917:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788869793.834395:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554754304 00000100:00100000:3.0:1788869793.834400:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554754304 00000100:00100000:3.0:1788869793.834425:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869793.834431:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17919:x1875765554754304:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788869793.834473:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17919:x1875765554754304:12345-0@lo:900:lod0001_rec0000.0 Request processed in 42us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869793.834479:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788869793.834506:0:17919:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99ffae6aea00 x1875765554754304/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788869809 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869793.834517:0:17919:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17919:1875765554754304:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788869793.834557:0:17919:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17919:1875765554754432:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788869793.834582:0:17919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869793.834599:0:17901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554754432 00000100:00100000:3.0:1788869793.834602:0:17901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554754432 00000100:00100000:3.0:1788869793.834623:0:17901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788869793.834628:0:17901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17919:x1875765554754432:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788869793.834672:0:17901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17919:x1875765554754432:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 44us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869793.834678:0:17901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788869793.834695:0:17919:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b669c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869793.834707:0:17919:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17919:1875765554754432:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788869793.834744:0:17919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869793.835697:0:17892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788869793.836398:0:17918:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788869793.836459:0:17918:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1788869793.838522:0:17892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788869793.838594:0:17892:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788869793.838794:0:17892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788869793.840810:0:17892:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:3.0:1788869793.841901:0:17919:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788869793.843057:0:17919:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788869793.843062:0:17919:0:(lod_dev.c:546:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:0.0:1788869793.844566:0:17892:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788869793.846043:0:17892:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788869793.846078:0:17892:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb76cc19d7988 00100000:10000000:3.0:1788869793.846096:0:17892:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788869793.847676:0:17892:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788869793.847704:0:17892:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788869793.847719:0:17892:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788869793.847737:0:17892:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788869793.860178:0:17892:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788869793.860437:0:17892:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788869794.072386:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84e423c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788869794.657842:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788869794.844176:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788869795.101245:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84e423c0 going to sleep for 0 seconds 10000000:01000000:0.0:1788869795.544334:0:17157:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788869795.544343:0:17157:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ffbf9b2000 from 8 10000000:01000000:0.0:1788869795.544349:0:17157:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788869795.544396:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04400/0xbead52e175fc3f05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869795.544409:0:17157:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04400/0xbead52e175fc3f05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869795.544439:0:17157:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04400/0xbead52e175fc3f05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869795.544469:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554754560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869795.544538:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869795.544603:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe81c14a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869795.544723:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554754560 00000100:00100000:1.0:1788869795.544731:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554754560 00000100:00100000:1.0:1788869795.544802:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788869795.544811:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+16:17157:x1875765554754560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869795.544824:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869795.544840:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff80031c00/0xbead52e175fc3f0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc3f05 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869795.544864:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff80031c00/0xbead52e175fc3f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc3f05 expref: 17 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869795.544874:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff80031c00/0xbead52e175fc3f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3f05 expref: 17 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869795.544882:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80031c00, rc 0) 00000100:00100000:1.0:1788869795.544941:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+17:17157:x1875765554754560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869795.544948:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788869795.544982:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554754560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869795.544998:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04400/0xbead52e175fc3f05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3f0c expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869795.545007:0:17157:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04400/0xbead52e175fc3f05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc3f0c expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869795.545059:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84019c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554754688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788869795.545102:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869795.545127:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89f4a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788869795.545233:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554754688 00000100:00100000:0.0:1788869795.545238:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554754688 00000100:00100000:0.0:1788869795.545287:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788869795.545329:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+17:17157:x1875765554754688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788869795.545344:0:17155:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788869795.545361:0:17155:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788869795.545364:0:17155:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788869795.545471:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+17:17157:x1875765554754688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 176us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869795.545478:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788869795.546036:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84019c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554754688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788869795.546111:0:17157:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788869795.546121:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04400/0xbead52e175fc3f05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3f0c expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869795.546132:0:17157:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04400/0xbead52e175fc3f05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3f0c expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869795.546143:0:17157:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788869795.546146:0:17157:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99fe81f16800 from 8 10000000:01000000:0.0:1788869795.546148:0:17157:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788869795.546171:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05200/0xbead52e175fc3f13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869795.546179:0:17157:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05200/0xbead52e175fc3f13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869795.546187:0:17157:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05200/0xbead52e175fc3f13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869795.546217:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554754816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869795.546248:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869795.546291:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554754816 00000100:00100000:0.0:1788869795.546298:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe81c14900 going to sleep for 11 seconds 00000100:00100000:2.0:1788869795.546301:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554754816 00000100:00100000:2.0:1788869795.546333:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788869795.546341:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+17:17157:x1875765554754816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869795.546350:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869795.546362:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fe823c1a00/0xbead52e175fc3f1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc3f13 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869795.546380:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fe823c1a00/0xbead52e175fc3f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc3f13 expref: 18 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869795.546391:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fe823c1a00/0xbead52e175fc3f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3f13 expref: 18 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869795.546399:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1a00, rc 0) 00000100:00100000:2.0:1788869795.546450:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:17157:x1875765554754816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869795.546456:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788869795.548951:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554754816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869795.548982:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05200/0xbead52e175fc3f13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3f1a expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869795.548994:0:17157:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05200/0xbead52e175fc3f13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc3f1a expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869795.549066:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554754944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788869795.549133:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869795.549183:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe81c14900 going to sleep for 11 seconds 00000100:00100000:1.0:1788869795.549293:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554754944 00000100:00100000:1.0:1788869795.549300:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554754944 00000100:00100000:1.0:1788869795.549353:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788869795.549362:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:17157:x1875765554754944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788869795.549383:0:17155:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788869795.549399:0:17155:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788869795.549402:0:17155:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788869795.549487:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:17157:x1875765554754944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869795.549495:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788869795.553616:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554754944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788869795.553679:0:17157:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788869795.553690:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05200/0xbead52e175fc3f13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3f1a expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869795.553702:0:17157:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05200/0xbead52e175fc3f13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3f1a expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869795.672461:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788869795.868022:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788869796.123396:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84e423c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788869796.708467:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869797.145355:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84e423c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788869797.720453:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788869798.064576:0:18161:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788869798.168353:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84e423c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788869798.745121:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788869798.809525:0:14945:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788869798.809531:0:14945:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788869798.809535:0:14945:0:(import.c:65:import_set_state_nolock()) ffff99ffbbf31000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869798.809549:0:14945:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99ffbbf31000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1788869798.809574:0:14945:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ffae6aed80 x1875765554755200/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869798.809592:0:14945:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869798.809597:0:14945:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869798.809600:0:14945:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869798.809603:0:14945:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869798.809626:0:14945:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869798.809630:0:14945:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869798.809645:0:14945:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869798.809648:0:14945:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788869798.809727:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554755200:0@lo:38:kworker.0 00000100:00100000:3.0:1788869798.809809:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869798.809878:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554755200 00000100:00100000:3.0:1788869798.809886:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554755200 00000100:00100000:3.0:1788869798.809921:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869798.809928:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3615:x1875765554755200:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788869798.809955:0:17165:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 416 last 0 00000020:00000080:3.0:1788869798.809990:0:17165:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbead52e175fc3f21 00000004:00100000:3.0:1788869798.810006:0:17165:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788869798.810012:0:17165:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1788869798.810200:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554755584:0@lo:400:kworker.0 00000100:00100000:2.0:1788869798.810240:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869798.810285:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869798.810292:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3616:1875765554755072:0@lo:400:kworker.0 00000100:00100000:2.0:1788869798.810321:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869798.810356:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554755584 00000100:00100000:2.0:1788869798.810360:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554755584 00000100:00100000:2.0:1788869798.810395:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869798.810401:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554755584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869798.810452:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554755584:12345-0@lo:400:kworker.0 Request processed in 50us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869798.810471:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869798.810496:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554755072 00000100:00100000:2.0:1788869798.810500:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554755072 00000100:00100000:2.0:1788869798.810548:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788869798.810555:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:3616:x1875765554755072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869798.810588:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:3616:x1875765554755072:12345-0@lo:400:kworker.0 Request processed in 33us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869798.810594:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788869798.810732:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3616:1875765554755072:0@lo:400:kworker.0 00010000:00080000:2.0:1788869798.810747:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffae6afb80 x1875765554755584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869798.810757:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554755584:0@lo:400:kworker.0 00000100:00100000:0.0:1788869798.811852:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554755712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869798.811908:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869798.811969:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554755328:0@lo:400:kworker.0 00000100:00100000:0.0:1788869798.811995:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869798.812028:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869798.812034:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554755456:0@lo:400:kworker.0 00000100:00100000:0.0:1788869798.812054:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869798.812086:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554755328 00000100:00100000:0.0:1788869798.812093:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554755328 00000100:00100000:0.0:1788869798.812130:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788869798.812138:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554755328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869798.812199:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554755328:12345-0@lo:400:kworker.0 Request processed in 62us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869798.812206:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788869798.812228:0:17901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554755712 00000100:00100000:0.0:1788869798.812231:0:17901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554755712 00000100:00100000:0.0:1788869798.812245:0:17901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554755456 00000100:00100000:0.0:1788869798.812247:0:17901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554755456 00000100:00100000:0.0:1788869798.812280:0:17901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788869798.812286:0:17901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1875765554755712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788869798.812310:0:17901:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788869798.812344:0:17901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1875765554755712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869798.812350:0:17901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788869798.812360:0:17901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788869798.812365:0:17901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554755456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869798.812387:0:17901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554755456:12345-0@lo:400:kworker.0 Request processed in 23us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869798.812393:0:17901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788869798.812428:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554755456:0@lo:400:kworker.0 00010000:00080000:0.0:1788869798.812438:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffae6ad500 x1875765554755328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869798.812446:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554755328:0@lo:400:kworker.0 00000100:00100000:0.0:1788869798.812470:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554755712:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788869798.821270:0:17165:0:(import.c:65:import_set_state_nolock()) ffff99ff8b158000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869798.821397:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1875765554755200:12345-0@lo:38:kworker.0 Request processed in 11465us (11584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869798.821412:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788869798.821666:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788869798.821677:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788869798.821682:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788869798.821685:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffbbf31000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788869798.821701:0:3615:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000573298a2): req@ffff99ffbfb1e680 x1875765554748288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869798.823587:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869798.823629:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84e423c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869798.824637:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554755200:0@lo:38:kworker.0 00000100:00100000:0.0:1788869798.824872:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869798.824898:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554755840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869798.824965:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869798.825133:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554748288 00000100:00100000:0.0:1788869798.825142:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554748288 00000100:00100000:0.0:1788869798.825183:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554755840 00000100:00100000:0.0:1788869798.825185:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554755840 00000100:00100000:0.0:1788869798.825199:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788869798.825206:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17202:x1875765554748288:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788869798.825331:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17202:x1875765554748288:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 124us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869798.825340:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788869798.825357:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788869798.825371:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1875765554755840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869798.825397:0:17166:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788869798.825443:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1875765554755840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869798.825462:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788869798.825515:0:17202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17202:1875765554748288:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788869798.825558:0:17202:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788869798.825785:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554755840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869798.825805:0:17202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bd180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17202:1875765554755968:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788869798.825842:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869798.825875:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe81c14600 going to sleep for 11 seconds 00000100:00100000:3.0:1788869798.826070:0:17901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554755968 00000100:00100000:3.0:1788869798.826075:0:17901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554755968 00000100:00100000:3.0:1788869798.826098:0:17901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788869798.826104:0:17901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17202:x1875765554755968:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788869798.826211:0:17901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17202:x1875765554755968:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 107us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869798.826218:0:17901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788869798.826360:0:17202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bd180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17202:1875765554755968:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788869798.826449:0:17202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17202:1875765554756096:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788869798.826491:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869798.826517:0:17202:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff86511a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869798.826592:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554756096 00000100:00100000:1.0:1788869798.826597:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554756096 00000100:00100000:0.0:1788869798.826649:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788869798.826657:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17202:x1875765554756096:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788869798.826717:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17202:x1875765554756096:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 62us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869798.826723:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788869798.826752:0:17202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17202:1875765554756096:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788869798.826795:0:17202:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869798.829045:0:17202:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788869798.829133:0:17202:0:(lod_dev.c:522:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:2.0:1788869798.829139:0:17202:0:(lod_dev.c:546:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1788869799.036784:0:18213:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869799.036987:0:18213:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788869799.769457:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788869800.016839:0:18263:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788869800.017126:0:18263:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788869800.792654:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788869800.948962:0:18312:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc30a15850 20000000:00000080:3.0:1788869800.949448:0:18312:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99ffba870000 uarg=0000000000000000 20000000:01000000:3.0:1788869800.949549:0:18312:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788869800.949557:0:18312:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788869800.949563:0:18312:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788869800.950228:0:18313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1788869800.951181:0:18312:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788869800.958523:0:18312:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788869800.958755:0:18312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99fe823c1200/0xbead52e175fc3f28 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869800.958831:0:18312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fe823c0200/0xbead52e175fc3dd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3dca expref: 17 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869800.958841:0:18312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ff80031000/0xbead52e175fc3ed4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3ecd expref: 17 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869800.958850:0:18312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99fe823c1200/0xbead52e175fc3f28 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869800.958898:0:18312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ff80031000/0xbead52e175fc3ed4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc3ecd expref: 17 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869800.958915:0:18312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ff80031000/0xbead52e175fc3ed4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc3ecd expref: 17 pid: 17154 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869800.958929:0:18312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18312:1875765554756224:0@lo:104: 00000100:00100000:2.0:1788869800.959070:0:18312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869800.959155:0:18312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fe823c0200/0xbead52e175fc3dd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc3dca expref: 17 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869800.959171:0:18312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fe823c0200/0xbead52e175fc3dd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc3dca expref: 17 pid: 17155 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869800.959180:0:18312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84019f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18312:1875765554756352:0@lo:104: 00000100:00100000:2.0:1788869800.959204:0:18312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869800.959727:0:18312:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff86511a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869800.959904:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554756224 00000100:00100000:1.0:1788869800.959912:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554756224 00000100:00100000:3.0:1788869800.960074:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554756352 00000100:00100000:3.0:1788869800.960077:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554756352 00000100:00100000:3.0:1788869800.960093:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869800.960102:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84018e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+4:18312:x1875765554756224:12345-0@lo:104: 00010000:00010000:3.0:1788869800.960118:0:17144:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc3ecd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3ed4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869800.960195:0:17144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788869800.960202:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84018e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+4:18312:x1875765554756224:12345-0@lo:104: Request processed in 100us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869800.960210:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869800.960228:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788869800.960234:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+3:18312:x1875765554756352:12345-0@lo:104: 00010000:00010000:3.0:1788869800.960241:0:17144:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04800/0xbead52e175fc3dca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3dd1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869800.960444:0:17144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788869800.960450:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+3:18312:x1875765554756352:12345-0@lo:104: Request processed in 217us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869800.960456:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869800.960633:0:18312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18312:1875765554756224:0@lo:104: 00000100:00100000:2.0:1788869800.960644:0:18312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84019f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18312:1875765554756352:0@lo:104: 00010000:00010000:2.0:1788869800.960684:0:18312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99fe823c1200/0xbead52e175fc3f28 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869800.960905:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788869800.960911:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc3ecd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3ed4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869800.960918:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fe00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1788869800.960922:0:17148:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc3ecd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc3ed4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869800.960931:0:17148:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc3ecd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc3ed4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869800.960966:0:17148:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc3ecd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc3ed4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869800.960972:0:17148:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788869800.961017:0:17148:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc3ecd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3ed4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869800.961024:0:17148:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788869800.961073:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3619:1875765554756480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869800.961114:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788869800.961165:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc3ecd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3ed4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869800.961174:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9fe00/0xbead52e175fc3ecd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3ed4 expref: -99 pid: 17892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869800.961184:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869800.961188:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04800/0xbead52e175fc3dca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3dd1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869800.961193:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04800 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1788869800.961196:0:17148:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04800/0xbead52e175fc3dca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc3dd1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869800.961202:0:17148:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04800/0xbead52e175fc3dca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc3dd1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869800.961208:0:17148:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04800/0xbead52e175fc3dca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc3dd1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869800.961213:0:17148:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788869800.961233:0:17148:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04800/0xbead52e175fc3dca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3dd1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869800.961239:0:17148:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869800.961279:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04800/0xbead52e175fc3dca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3dd1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869800.961286:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04800/0xbead52e175fc3dca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3dd1 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869800.961300:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869800.961302:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869800.961303:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869800.961318:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3616:1875765554756608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869800.961346:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788869800.961937:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869800.963590:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554756480 00000100:00100000:0.0:1788869800.963603:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554756480 00010000:00010000:0.0:1788869800.963641:0:17146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ff80031000/0xbead52e175fc3ed4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3ecd expref: 18 pid: 17154 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869800.963686:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554756608 00000100:00100000:0.0:1788869800.963689:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554756608 00010000:00010000:0.0:1788869800.963700:0:17146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fe823c0200/0xbead52e175fc3dd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3dca expref: 19 pid: 17155 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869800.963713:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788869800.963721:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+19:3619:x1875765554756480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869800.963751:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869800.963757:0:17146:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ff80031000/0xbead52e175fc3ed4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3ecd expref: 19 pid: 17154 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869800.963770:0:17146:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ff80031000/0xbead52e175fc3ed4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc3ecd expref: 19 pid: 17154 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869800.963867:0:17145:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788869800.963878:0:17145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788869800.964177:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788869800.964192:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+19:3616:x1875765554756608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869800.964202:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869800.964207:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fe823c0200/0xbead52e175fc3dd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3dca expref: 19 pid: 17155 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869800.964477:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fe823c0200/0xbead52e175fc3dd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc3dca expref: 19 pid: 17155 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869800.964496:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fe823c0200/0xbead52e175fc3dd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc3dca expref: 19 pid: 17155 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869800.964511:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869800.965446:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:3616:x1875765554756608:12345-0@lo:103:ldlm_bl.0 Request processed in 1255us (4092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869800.965473:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788869800.965553:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff80031000/0xbead52e175fc3ed4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc3ecd expref: 17 pid: 17154 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869800.965570:0:17146:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99fe823c1200/0xbead52e175fc3f28 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869800.965578:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fe823c1200/0xbead52e175fc3f28 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869800.965594:0:17146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99fe823c1200/0xbead52e175fc3f28 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869800.965600:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99fe823c1200/0xbead52e175fc3f28 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869800.965606:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99fe823c1200/0xbead52e175fc3f28 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869800.965612:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99fe823c1200/0xbead52e175fc3f28 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869800.965618:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1200 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869800.965622:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99fe823c1200/0xbead52e175fc3f28 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869800.965640:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99fe823c1200/0xbead52e175fc3f28 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869800.965664:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99fe823c1200/0xbead52e175fc3f28 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869800.965675:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869800.965730:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+16:3619:x1875765554756480:12345-0@lo:103:ldlm_bl.0 Request processed in 2010us (4616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869800.965736:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869800.965819:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3619:1875765554756480:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788869800.965933:0:18312:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99fe823c1200/0xbead52e175fc3f28 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869800.965941:0:18312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99fe823c1200/0xbead52e175fc3f28 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869800.965947:0:18312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fe823c1200/0xbead52e175fc3f28 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869800.967589:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3616:1875765554756608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869801.820716:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869802.203423:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788869802.841114:0:17157:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788869802.841123:0:17157:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ffbf9b2000 from 13 10000000:01000000:2.0:1788869802.841129:0:17157:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788869802.841184:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99fe823c0400/0xbead52e175fc3f2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869802.841197:0:17157:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99fe823c0400/0xbead52e175fc3f2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869802.841207:0:17157:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99fe823c0400/0xbead52e175fc3f2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869802.841233:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84019f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554756736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869802.841340:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869802.841383:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff87cc6180 going to sleep for 11 seconds 00000100:00100000:1.0:1788869802.841481:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554756736 00000100:00100000:1.0:1788869802.841488:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554756736 00000100:00100000:1.0:1788869802.841533:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788869802.841542:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+16:17157:x1875765554756736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869802.841555:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869802.841570:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff80031200/0xbead52e175fc3f36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc3f2f expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869802.841594:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff80031200/0xbead52e175fc3f36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc3f2f expref: 17 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869802.841605:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff80031200/0xbead52e175fc3f36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3f2f expref: 17 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869802.841614:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80031200, rc 0) 00000100:00100000:1.0:1788869802.841662:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+17:17157:x1875765554756736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869802.841669:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00010000:1.0:1788869802.841727:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869802.844902:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84019f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554756736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869802.845119:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99fe823c0400/0xbead52e175fc3f2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3f36 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869802.845133:0:17157:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99fe823c0400/0xbead52e175fc3f2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc3f36 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869802.845229:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554756864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869802.845312:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869802.845353:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe81c14600 going to sleep for 11 seconds 00000100:00100000:0.0:1788869802.845383:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554756864 00000100:00100000:0.0:1788869802.845389:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554756864 00000100:00100000:0.0:1788869802.845426:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788869802.845436:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+17:17157:x1875765554756864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869802.845558:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+17:17157:x1875765554756864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869802.845565:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788869802.845617:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554756864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869802.845643:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554756992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869802.845680:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869802.845694:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe81c14600 going to sleep for 11 seconds 00000100:00100000:0.0:1788869802.845712:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554756992 00000100:00100000:0.0:1788869802.845716:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554756992 00000100:00100000:0.0:1788869802.845736:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788869802.845757:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+17:17157:x1875765554756992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869802.845839:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+17:17157:x1875765554756992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869802.845846:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788869802.845882:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554756992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788869802.847467:0:18379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788869802.847659:0:17157:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788869802.847679:0:17157:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869802.847688:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99fe823c0400/0xbead52e175fc3f2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3f36 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869802.847699:0:17157:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99fe823c0400/0xbead52e175fc3f2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3f36 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869802.847722:0:17157:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788869802.847725:0:17157:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99fe81f16800 from 13 10000000:01000000:1.0:1788869802.847727:0:17157:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869802.847768:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc3f3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869802.847776:0:17157:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc3f3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869802.847786:0:17157:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc3f3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869802.847809:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554757120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869802.847864:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869802.848125:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554757120 00000100:00100000:0.0:1788869802.848132:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554757120 00000100:00100000:0.0:1788869802.848182:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788869802.848192:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+17:17157:x1875765554757120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869802.848205:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869802.848219:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffbfb04200/0xbead52e175fc3f44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc3f3d expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869802.848244:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffbfb04200/0xbead52e175fc3f44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc3f3d expref: 18 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869802.848275:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffbfb04200/0xbead52e175fc3f44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3f3d expref: 18 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869802.848295:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04200, rc 0) 00000100:00100000:0.0:1788869802.848329:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:17157:x1875765554757120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869802.848336:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788869802.856842:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff9553db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869802.856890:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554757120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869802.856916:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc3f3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3f44 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869802.857268:0:17157:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc3f3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc3f44 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869802.857358:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554757248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869802.857420:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869802.858437:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff9553db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869802.860084:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554757248 00000100:00100000:2.0:1788869802.860097:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554757248 00000100:00100000:2.0:1788869802.860169:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788869802.860179:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:17157:x1875765554757248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869802.860359:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:17157:x1875765554757248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (2938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869802.860367:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788869802.860421:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554757248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869802.860472:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554757376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869802.860518:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869802.860544:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff87cc6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869802.860557:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554757376 00000100:00100000:2.0:1788869802.860561:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554757376 00000100:00100000:2.0:1788869802.860580:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788869802.860585:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:17157:x1875765554757376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869802.860653:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:17157:x1875765554757376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869802.860659:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788869802.860692:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554757376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788869802.861359:0:18381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788869802.861410:0:17157:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788869802.861430:0:17157:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788869802.861440:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc3f3d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3f44 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869802.861458:0:17157:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc3f3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3f44 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869803.867543:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869803.929234:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554757504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869803.929344:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869803.929403:0:3615:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869793/real 1788869793] req@ffff99fe8401a300 x1875765554751488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869803 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869803.929424:0:3615:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99fe8401a300 x1875765554751488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869803 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869803.929434:0:3615:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869793/real 1788869793] req@ffff99fe84018380 x1875765554751232/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869803 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869803.929445:0:3615:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99fe84018380 x1875765554751232/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869803 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788869803.929457:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ff87c82800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869803.929472:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788869803.929476:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554751488:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788869803.929481:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99fe83b0c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869803.929486:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788869803.929489:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554751232:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788869803.929515:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554757504 00000100:00100000:2.0:1788869803.929522:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554757504 00000100:00100000:2.0:1788869803.929569:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788869803.929579:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554757504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869803.929624:0:17166:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788869803.929714:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554757504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869803.929721:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788869803.929771:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869803.929776:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788869803.929779:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869803.929782:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788869803.929794:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869803.929798:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788869803.929800:0:36:0:(import.c:65:import_set_state_nolock()) ffff99fe83b0c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869803.929804:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 411 00000100:00080000:2.0:1788869803.929809:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788869803.929813:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99fe83b0c000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788869803.929832:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe8401bb80 x1875765554758016/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869803.929844:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869803.929847:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788869803.929849:0:36:0:(import.c:65:import_set_state_nolock()) ffff99ff87c82800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869803.929851:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 411 00000100:00080000:2.0:1788869803.929854:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788869803.929856:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99ff87c82800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788869803.929866:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe8401b100 x1875765554758144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788869803.929933:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3618:1875765554757632:0@lo:400:kworker.0 00000100:00100000:2.0:1788869803.929964:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869803.929992:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869803.929997:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554757760:0@lo:400:kworker.0 00000100:00100000:2.0:1788869803.930036:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869803.930066:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554757632 00000100:00100000:2.0:1788869803.930069:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554757632 00000100:00100000:2.0:1788869803.930096:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788869803.930102:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:3618:x1875765554757632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869803.930137:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:3618:x1875765554757632:12345-0@lo:400:kworker.0 Request processed in 35us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869803.930143:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788869803.930170:0:17901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554757760 00000100:00100000:2.0:1788869803.930174:0:17901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554757760 00000100:00100000:2.0:1788869803.930209:0:17901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788869803.930215:0:17901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1875765554757760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869803.930246:0:17901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1875765554757760:12345-0@lo:400:kworker.0 Request processed in 31us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869803.930273:0:17901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788869803.930295:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554757888:0@lo:400:kworker.0 00000100:00100000:2.0:1788869803.930328:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869803.930347:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869803.930352:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554758272:0@lo:400:kworker.0 00000100:00100000:2.0:1788869803.930373:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869803.930398:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554757888 00000100:00100000:2.0:1788869803.930407:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554757888 00000100:00100000:2.0:1788869803.930429:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554758272 00000100:00100000:2.0:1788869803.930432:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554758272 00000100:00100000:2.0:1788869803.930445:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869803.930451:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554757888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869803.930484:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554757888:12345-0@lo:400:kworker.0 Request processed in 33us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869803.930490:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869803.930501:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869803.930507:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554758272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869803.930532:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554758272:12345-0@lo:400:kworker.0 Request processed in 25us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869803.930538:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788869803.930575:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99fe8401ad80 x1875765554758272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869803.930586:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554758272:0@lo:400:kworker.0 00010000:00080000:2.0:1788869803.930595:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99fe84019500 x1875765554757888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869803.930602:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554757888:0@lo:400:kworker.0 00000100:00100000:2.0:1788869803.930622:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554758016:0@lo:8:kworker.0 00000400:00000100:2.0:1788869803.930646:0:3615:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765554758016 offset 0 length 520: 4 00000100:00100000:2.0:1788869803.930658:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554758144:0@lo:8:kworker.0 00000400:00000100:2.0:1788869803.930674:0:3615:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765554758144 offset 0 length 520: 4 00000100:00100000:2.0:1788869803.930697:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554757760:0@lo:400:kworker.0 00000100:00100000:2.0:1788869803.930713:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3618:1875765554757632:0@lo:400:kworker.0 00000100:00100000:2.0:1788869803.930743:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554757504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869803.931092:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869803.931102:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554758400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869803.931132:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869803.931158:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554758400 00000100:00100000:0.0:1788869803.931163:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554758400 00000100:00100000:0.0:1788869803.931213:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788869803.931220:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1875765554758400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869803.931240:0:17165:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788869803.931303:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1875765554758400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869803.931309:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788869803.931338:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554758400:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788869804.889349:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788869804.957787:0:17893:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:3.0:1788869805.080966:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788869805.912592:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869805.976346:0:3615:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869790/real 1788869790] req@ffff99ffae6ac000 x1875765554749312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869805 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869805.976376:0:3615:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99ffae6ac000 x1875765554749312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869805 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869805.976387:0:3615:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869790/real 1788869790] req@ffff99ffae6ac700 x1875765554749440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869805 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869805.976398:0:3615:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99ffae6ac700 x1875765554749440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869805 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788869805.976418:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffae5cb800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869805.976437:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788869805.976441:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554749312:0@lo:8:kworker.0 00000100:00080000:2.0:1788869805.976446:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffb89f1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869805.976452:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788869805.976455:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554749440:0@lo:8:kworker.0 00000100:00080000:0.0:1788869805.976670:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869805.976675:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788869805.976687:0:37:0:(import.c:65:import_set_state_nolock()) ffff99ffae5cb800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869805.976699:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 408 00000100:00080000:0.0:1788869805.976704:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788869805.976710:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ffae5cb800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788869805.976731:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe839bc000 x1875765554758784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869805.976753:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869805.976756:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788869805.976758:0:37:0:(import.c:65:import_set_state_nolock()) ffff99ffb89f1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869805.976761:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 408 00000100:00080000:0.0:1788869805.976764:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788869805.976768:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ffb89f1000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788869805.976781:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe839bed80 x1875765554758912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869805.976804:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869805.976807:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869805.976810:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869805.976813:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788869805.976839:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554758656:0@lo:400:kworker.0 00000100:00100000:0.0:1788869805.976923:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869805.976963:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869805.976968:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554759040:0@lo:400:kworker.0 00000100:00100000:0.0:1788869805.976992:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869805.977022:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554758656 00000100:00100000:0.0:1788869805.977029:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554758656 00000100:00100000:0.0:1788869805.977068:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788869805.977075:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554758656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869805.977120:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554758656:12345-0@lo:400:kworker.0 Request processed in 45us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869805.977135:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788869805.977156:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554759040 00000100:00100000:0.0:1788869805.977159:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554759040 00000100:00100000:0.0:1788869805.977181:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788869805.977187:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554759040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869805.977217:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554759040:12345-0@lo:400:kworker.0 Request processed in 30us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869805.977223:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788869805.977247:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554758784:0@lo:8:kworker.0 00000400:00000100:0.0:1788869805.977291:0:3615:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765554758784 offset 0 length 520: 4 00000100:00100000:0.0:1788869805.977307:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554758912:0@lo:8:kworker.0 00000400:00000100:0.0:1788869805.977323:0:3615:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765554758912 offset 0 length 520: 4 00010000:00080000:0.0:1788869805.977353:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99fe84026a00 x1875765554759040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869805.977364:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554759040:0@lo:400:kworker.0 00000100:00100000:0.0:1788869805.977373:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554758656:0@lo:400:kworker.0 00000100:00100000:3.0:1788869805.977513:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554759168:0@lo:400:kworker.0 00000100:00100000:3.0:1788869805.977540:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869805.977565:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788869805.977570:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3618:1875765554758528:0@lo:400:kworker.0 00000100:00100000:3.0:1788869805.977595:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869805.977617:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554759296:0@lo:400:kworker.0 00000100:00100000:3.0:1788869805.977637:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869805.977659:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554758528 00000100:00100000:3.0:1788869805.977662:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554758528 00000100:00100000:3.0:1788869805.977702:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788869805.977709:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:3618:x1875765554758528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869805.977745:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:3618:x1875765554758528:12345-0@lo:400:kworker.0 Request processed in 36us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869805.977750:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788869805.977785:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3618:1875765554758528:0@lo:400:kworker.0 00000100:00100000:0.0:1788869805.978036:0:17901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554759168 00000100:00100000:0.0:1788869805.978041:0:17901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554759168 00000100:00100000:0.0:1788869805.978103:0:17901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788869805.978110:0:17901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554759168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869805.978148:0:17901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554759168:12345-0@lo:400:kworker.0 Request processed in 39us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869805.978155:0:17901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788869805.978810:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554759168:0@lo:400:kworker.0 00000100:00100000:3.0:1788869805.979338:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554759296 00000100:00100000:3.0:1788869805.979345:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554759296 00000100:00100000:3.0:1788869805.979389:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788869805.979396:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554759296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869805.979458:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554759296:12345-0@lo:400:kworker.0 Request processed in 62us (1819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869805.979465:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788869805.979506:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99fe84024700 x1875765554759296/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869805.979517:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554759296:0@lo:400:kworker.0 00010000:00010000:1.0:1788869806.936373:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788869807.580109:0:18662:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788869807.580114:0:18662:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788869807.580116:0:18662:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788869807.580233:0:18662:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99fe81cb4800 00000020:01000004:2.0:1788869807.580249:0:18662:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788869807.580294:0:18662:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788869807.580309:0:18662:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99ff9568b380) 00000020:00000080:2.0:1788869807.580327:0:18662:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788869807.628694:0:18662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788869807.630151:0:18662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788869807.630436:0:18662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788869807.630725:0:18662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788869807.630916:0:18662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788869807.631343:0:18662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788869807.631521:0:18662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1788869807.637457:0:18662:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788869807.637634:0:18662:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788869807.637645:0:18662:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788869807.637666:0:18662:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbead52e175fc3f52 00000020:01000004:3.0:1788869807.637672:0:18662:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788869807.637689:0:18662:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.130@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788869807.637692:0:18662:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788869807.637697:0:18662:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788869807.637700:0:18662:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788869807.637709:0:18662:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99ffbaf43380) 00000020:00000080:3.0:1788869807.637716:0:18662:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788869807.638716:0:18662:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869807.638826:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788869807.638833:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788869807.641581:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788869807.641592:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788869807.642092:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788869807.642099:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788869807.643500:0:18662:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869807.643668:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788869807.643674:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788869807.644426:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788869807.644434:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788869807.657071:0:18662:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788869807.657327:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788869807.657335:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788869807.658539:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788869807.658548:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788869807.659281:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788869807.659290:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788869807.661387:0:18662:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869807.661572:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788869807.661583:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788869807.662221:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788869807.662228:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788869807.689738:0:18662:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788869807.690026:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788869807.690033:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788869807.691180:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788869807.691190:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788869807.691750:0:18662:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788869807.691846:0:18662:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788869807.691883:0:18662:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788869807.708772:0:18662:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788869807.708885:0:18662:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.130@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788869807.708893:0:18662:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788869807.708895:0:18662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788869807.708896:0:18662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869807.708897:0:18662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869807.708898:0:18662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869807.708899:0:18662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869807.708900:0:18662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869807.708902:0:18662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869807.708903:0:18662:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788869807.708907:0:18662:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788869807.708909:0:18662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788869807.708910:0:18662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788869807.708911:0:18662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869807.708912:0:18662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869807.708913:0:18662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869807.708914:0:18662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869807.708915:0:18662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869807.708916:0:18662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869807.708917:0:18662:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788869807.708943:0:18662:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788869807.708965:0:18662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554759424:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788869807.709041:0:18662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869807.709145:0:18662:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8860c300 going to sleep for 11 seconds 00000100:00100000:2.0:1788869807.709186:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554759424 00000100:00100000:2.0:1788869807.709194:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554759424 00000100:00100000:2.0:1788869807.709294:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788869807.709304:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:18662:x1875765554759424:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788869807.709335:0:17153:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788869807.709338:0:17153:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788869807.709342:0:17153:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788869807.709877:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:18662:x1875765554759424:12345-0@lo:253:mount.lustre.0 Request processed in 572us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869807.709885:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788869807.709954:0:18662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554759424:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788869807.709965:0:18662:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788869807.709967:0:18662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788869807.709968:0:18662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788869807.709969:0:18662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869807.709970:0:18662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869807.709971:0:18662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869807.709972:0:18662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869807.709973:0:18662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869807.709975:0:18662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869807.709976:0:18662:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788869807.709995:0:18662:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99fe81cb4800 from lustre-OST0000 10000000:01000000:3.0:1788869807.710019:0:18662:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788869807.710022:0:18662:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788869807.710037:0:18662:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99ffbf908000 local copy 00010000:00010000:3.0:1788869807.710047:0:18662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99fe823c0800/0xbead52e175fc3d0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3d14 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869807.710143:0:18662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554759552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869807.710173:0:18662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869807.710240:0:18662:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8860c180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869807.710431:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554759552 00000100:00100000:2.0:1788869807.710436:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554759552 00000100:00100000:2.0:1788869807.710468:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788869807.710475:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:18662:x1875765554759552:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869807.710549:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:18662:x1875765554759552:12345-0@lo:501:mount.lustre.0 Request processed in 74us (375us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788869807.710556:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788869807.710649:0:18662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554759552:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788869807.710683:0:18662:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788869807.710701:0:18662:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788869807.710707:0:18662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99fe823c0800/0xbead52e175fc3d0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3d14 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.710716:0:18662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99fe823c0800/0xbead52e175fc3d0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3d14 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869807.710739:0:18662:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99fe81cb4800 10000000:01000000:0.0:1788869807.710744:0:18662:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788869807.710749:0:18662:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788869807.710751:0:18662:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788869807.710755:0:18662:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788869807.710758:0:18662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788869807.710791:0:18662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05a00/0xbead52e175fc3f60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.710799:0:18662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05a00/0xbead52e175fc3f60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.710808:0:18662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05a00/0xbead52e175fc3f60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869807.710823:0:18662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84026a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554759680:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788869807.710861:0:18662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869807.710889:0:18662:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd480 going to sleep for 11 seconds 00000100:00100000:2.0:1788869807.710945:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554759680 00000100:00100000:2.0:1788869807.710951:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554759680 00000100:00100000:2.0:1788869807.710981:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788869807.710988:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+18:18662:x1875765554759680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869807.710996:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869807.711008:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fe823c0c00/0xbead52e175fc3f67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc3f60 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869807.711027:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fe823c0c00/0xbead52e175fc3f67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc3f60 expref: 19 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869807.711037:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fe823c0c00/0xbead52e175fc3f67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3f60 expref: 19 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869807.711046:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0c00, rc 0) 00000100:00100000:2.0:1788869807.711072:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+19:18662:x1875765554759680:12345-0@lo:101:mount.lustre.0 Request processed in 85us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869807.711078:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788869807.711216:0:18662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84026a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554759680:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869807.711230:0:18662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05a00/0xbead52e175fc3f60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3f67 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.711246:0:18662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05a00/0xbead52e175fc3f60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc3f67 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788869807.712416:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788869807.713003:0:18662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869807.714914:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788869807.714962:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788869807.714978:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788869807.715009:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788869807.715025:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788869807.715039:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788869807.715063:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788869807.715069:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788869807.715167:0:18662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84026a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554759808:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869807.715231:0:18662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869807.715377:0:18662:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd540 going to sleep for 11 seconds 00000100:00100000:2.0:1788869807.715484:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554759808 00000100:00100000:2.0:1788869807.715492:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554759808 00000100:00100000:2.0:1788869807.715573:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788869807.715584:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+19:18662:x1875765554759808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869807.715744:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+19:18662:x1875765554759808:12345-0@lo:501:mount.lustre.0 Request processed in 161us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869807.715753:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788869807.715839:0:18662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84026a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554759808:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869807.715889:0:18662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554759936:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869807.715932:0:18662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869807.716148:0:18662:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe81c14000 going to sleep for 11 seconds 00000100:00100000:0.0:1788869807.716240:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554759936 00000100:00100000:0.0:1788869807.716246:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554759936 00000100:00100000:0.0:1788869807.716298:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788869807.716306:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+19:18662:x1875765554759936:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869807.717067:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+19:18662:x1875765554759936:12345-0@lo:503:mount.lustre.0 Request processed in 760us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869807.717077:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788869807.717180:0:18662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554759936:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788869807.717898:0:18662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788869807.717980:0:18662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554760064:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869807.718033:0:18662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869807.718143:0:18662:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe81c14000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869807.718385:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554760064 00000100:00100000:3.0:1788869807.718392:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554760064 00000100:00100000:2.0:1788869807.718544:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788869807.718553:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+19:18662:x1875765554760064:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869807.719060:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+19:18662:x1875765554760064:12345-0@lo:502:mount.lustre.0 Request processed in 507us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869807.719074:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788869807.719160:0:18662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554760064:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788869807.719377:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788869807.719408:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788869807.719423:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788869807.719448:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788869807.719461:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788869807.719474:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788869807.719487:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788869807.719500:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788869807.719512:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788869807.719527:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788869807.719540:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788869807.719554:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788869807.719586:0:18662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84026680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554760192:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869807.719627:0:18662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869807.719841:0:18662:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd480 going to sleep for 11 seconds 00000100:00100000:2.0:1788869807.719906:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554760192 00000100:00100000:2.0:1788869807.719912:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554760192 00000100:00100000:2.0:1788869807.719950:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788869807.719958:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+19:18662:x1875765554760192:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869807.720053:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+19:18662:x1875765554760192:12345-0@lo:502:mount.lustre.0 Request processed in 95us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869807.720059:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788869807.720143:0:18662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84026680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554760192:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788869807.720188:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788869807.720196:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1788869807.721004:0:18679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788869807.721012:0:18679:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788869807.721019:0:18679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869807.721021:0:18679:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788869807.721027:0:18679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788869807.721041:0:18679:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99ffbaf44d40) 00000020:00000080:3.0:1788869807.721066:0:18679:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788869807.721072:0:18679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788869807.721161:0:18679:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99fe81cb4800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788869807.721170:0:18679:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788869807.721177:0:18679:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbead52e175fc3f75 00010000:00010000:2.0:1788869807.732509:0:18679:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1788869807.733079:0:18679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1788869807.737869:0:18679:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788869807.739518:0:18679:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788869807.739532:0:18679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869807.739539:0:18679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869807.739542:0:18679:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788869807.739545:0:18679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788869807.739548:0:18679:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788869807.739550:0:18679:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788869807.739551:0:18679:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788869807.739553:0:18679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788869807.739555:0:18679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869807.739556:0:18679:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788869807.739559:0:18679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869807.739562:0:18679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869807.739563:0:18679:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788869807.739566:0:18679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788869807.739568:0:18679:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788869807.739570:0:18679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869807.739572:0:18679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869807.739573:0:18679:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788869807.739582:0:18679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869807.739585:0:18679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869807.739586:0:18679:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788869807.739590:0:18679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788869807.739620:0:18679:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869807.739623:0:18679:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869807.739624:0:18679:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788869807.739627:0:18679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788869807.739802:0:18662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788869807.739835:0:18662:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788869807.739865:0:18662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05a00/0xbead52e175fc3f60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3f67 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869807.739877:0:18662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05a00/0xbead52e175fc3f60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3f67 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869807.739896:0:18662:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99fe81cb4800 from 1 10000000:01000000:3.0:1788869807.739899:0:18662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788869807.739933:0:18662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3f7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869807.739940:0:18662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3f7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869807.739950:0:18662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3f7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869807.739974:0:18662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554760320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788869807.740039:0:18662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869807.740071:0:18662:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8860c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788869807.743978:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554760320 00000100:00100000:2.0:1788869807.743992:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554760320 00000100:00100000:2.0:1788869807.744055:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788869807.744066:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+19:18662:x1875765554760320:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869807.744085:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869807.744106:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fe823c0a00/0xbead52e175fc3f83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc3f7c expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869807.744135:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fe823c0a00/0xbead52e175fc3f83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc3f7c expref: 20 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869807.744145:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fe823c0a00/0xbead52e175fc3f83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3f7c expref: 20 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869807.744154:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0a00, rc 0) 00000100:00100000:2.0:1788869807.744231:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+20:18662:x1875765554760320:12345-0@lo:101:mount.lustre.0 Request processed in 167us (4191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869807.744238:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788869807.744553:0:18662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554760320:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869807.744572:0:18662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3f7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3f83 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869807.744581:0:18662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3f7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc3f83 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788869807.749754:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788869807.750117:0:18662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869807.751449:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788869807.751487:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788869807.751510:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788869807.751518:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788869807.751622:0:18662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84026d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554760448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869807.752876:0:18662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869807.753563:0:18662:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89aaa480 going to sleep for 11 seconds 00000100:00100000:2.0:1788869807.754237:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554760448 00000100:00100000:2.0:1788869807.754248:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554760448 00000100:00100000:2.0:1788869807.754332:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788869807.754343:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+20:18662:x1875765554760448:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869807.754522:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+20:18662:x1875765554760448:12345-0@lo:501:mount.lustre.0 Request processed in 181us (1649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869807.754530:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788869807.754925:0:18662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84026d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554760448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869807.754973:0:18662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554760576:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869807.755022:0:18662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869807.755054:0:18662:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8860c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788869807.755608:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554760576 00000100:00100000:2.0:1788869807.755616:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554760576 00000100:00100000:2.0:1788869807.755646:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788869807.755664:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83940450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+20:18662:x1875765554760576:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869807.755784:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83940450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+20:18662:x1875765554760576:12345-0@lo:503:mount.lustre.0 Request processed in 110us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869807.755791:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788869807.756148:0:18662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554760576:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788869807.756740:0:18662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788869807.756913:0:18662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554760704:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869807.756970:0:18662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869807.757056:0:18662:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8860c900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869807.759528:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554760704 00000100:00100000:0.0:1788869807.759542:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554760704 00000100:00100000:0.0:1788869807.759611:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788869807.759622:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+20:18662:x1875765554760704:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869807.760933:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+20:18662:x1875765554760704:12345-0@lo:502:mount.lustre.0 Request processed in 1308us (3958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869807.760944:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788869807.761066:0:18662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554760704:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788869807.761377:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788869807.761412:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788869807.761427:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788869807.761440:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788869807.761453:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788869807.761466:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788869807.761479:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788869807.761492:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1788869807.761505:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788869807.761518:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1788869807.761531:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1788869807.761568:0:18662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554760832:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869807.761624:0:18662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869807.761666:0:18662:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8860c900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869807.761903:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554760832 00000100:00100000:0.0:1788869807.761916:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554760832 00000100:00100000:0.0:1788869807.761964:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788869807.761974:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83942c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+20:18662:x1875765554760832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869807.762073:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83942c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+20:18662:x1875765554760832:12345-0@lo:502:mount.lustre.0 Request processed in 101us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869807.762080:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788869807.762784:0:18662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554760832:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788869807.762855:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1788869807.762867:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788869807.764581:0:18683:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869807.764595:0:18683:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869807.764598:0:18683:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788869807.764606:0:18683:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99fe81cb4800 00000020:00000080:0.0:1788869807.764609:0:18683:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788869807.764618:0:18683:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869807.764620:0:18683:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869807.764622:0:18683:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788869807.764624:0:18683:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869807.764626:0:18683:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869807.764627:0:18683:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788869807.764630:0:18683:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99fe81cb4800 00000020:00000080:0.0:1788869807.764632:0:18683:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788869807.764810:0:18683:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869807.764814:0:18683:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869807.764816:0:18683:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788869807.764818:0:18683:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869807.764821:0:18683:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869807.764822:0:18683:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788869807.764826:0:18683:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99fe81cb4800 00000020:00000080:0.0:1788869807.764828:0:18683:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788869807.784796:0:18683:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869807.784830:0:18683:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869807.784833:0:18683:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788869807.784837:0:18683:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869807.784842:0:18683:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869807.784860:0:18683:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788869807.784867:0:18683:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99fe81cb4800 00000020:00000080:0.0:1788869807.784869:0:18683:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788869807.784953:0:18683:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869807.784956:0:18683:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869807.784958:0:18683:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788869807.784961:0:18683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1788869807.787858:0:18662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788869807.787905:0:18662:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788869807.787933:0:18662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3f7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3f83 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869807.787947:0:18662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3f7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3f83 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869807.788031:0:18662:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788869807.788034:0:18662:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99fe81cb4800 10000000:01000000:3.0:1788869807.788038:0:18662:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99fe81cb4800 10000000:01000000:3.0:1788869807.788042:0:18662:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788869807.788048:0:18662:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99fe81cb4800 from 1 10000000:01000000:3.0:1788869807.788051:0:18662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788869807.788086:0:18662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f800/0xbead52e175fc3f8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869807.788095:0:18662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f800/0xbead52e175fc3f8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869807.788106:0:18662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f800/0xbead52e175fc3f8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869807.788132:0:18662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554760960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788869807.788199:0:18662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869807.788237:0:18662:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8860c900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869807.789790:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554760960 00000100:00100000:0.0:1788869807.789801:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554760960 00000100:00100000:0.0:1788869807.789861:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788869807.789871:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+20:18662:x1875765554760960:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869807.789887:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869807.789904:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffbfb04000/0xbead52e175fc3f91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc3f8a expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.789931:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffbfb04000/0xbead52e175fc3f91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc3f8a expref: 21 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.789943:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffbfb04000/0xbead52e175fc3f91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3f8a expref: 21 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.789952:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04000, rc 0) 00000100:00100000:0.0:1788869807.790025:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:18662:x1875765554760960:12345-0@lo:101:mount.lustre.0 Request processed in 156us (1825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869807.790032:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788869807.794819:0:18662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554760960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869807.794860:0:18662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f800/0xbead52e175fc3f8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3f91 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869807.794875:0:18662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f800/0xbead52e175fc3f8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc3f91 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788869807.807279:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788869807.807577:0:18662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788869807.807779:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788869807.807811:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788869807.807827:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788869807.807840:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788869807.807867:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788869807.807882:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788869807.807894:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788869807.807906:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788869807.807918:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788869807.807931:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788869807.807945:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788869807.807958:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788869807.807972:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788869807.807985:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788869807.807999:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788869807.808026:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788869807.808040:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788869807.808050:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788869807.808061:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788869807.808073:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788869807.808085:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788869807.808097:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788869807.808110:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788869807.808124:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788869807.808136:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788869807.808149:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788869807.808161:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788869807.808173:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788869807.808185:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788869807.808199:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788869807.808211:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788869807.808237:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788869807.808279:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788869807.808295:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788869807.808319:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788869807.808332:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788869807.808345:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788869807.808364:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788869807.808369:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788869807.808454:0:18662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554761088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869807.808524:0:18662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869807.808564:0:18662:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8860c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788869807.813332:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554761088 00000100:00100000:0.0:1788869807.813346:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554761088 00000100:00100000:0.0:1788869807.813405:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788869807.813416:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:18662:x1875765554761088:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869807.813611:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:18662:x1875765554761088:12345-0@lo:501:mount.lustre.0 Request processed in 197us (5086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869807.813627:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788869807.814388:0:18662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554761088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869807.814440:0:18662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554761216:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869807.814495:0:18662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869807.816070:0:18662:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8860c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788869807.819026:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554761216 00000100:00100000:0.0:1788869807.819043:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554761216 00000100:00100000:0.0:1788869807.819282:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788869807.819295:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83941850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:18662:x1875765554761216:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869807.819459:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83941850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:18662:x1875765554761216:12345-0@lo:503:mount.lustre.0 Request processed in 166us (4963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869807.819467:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788869807.819565:0:18662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554761216:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788869807.820013:0:18662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788869807.820105:0:18662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554761344:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869807.820151:0:18662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869807.824141:0:18662:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8b72780 going to sleep for 11 seconds 00000100:00100000:1.0:1788869807.824210:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554761344 00000100:00100000:1.0:1788869807.824219:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554761344 00000100:00100000:1.0:1788869807.831122:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788869807.831143:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:18662:x1875765554761344:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869807.831339:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:18662:x1875765554761344:12345-0@lo:502:mount.lustre.0 Request processed in 205us (11187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869807.831352:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788869807.831476:0:18662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554761344:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869807.831710:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788869807.831741:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788869807.831757:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788869807.831770:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788869807.831782:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788869807.831795:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788869807.831826:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788869807.831840:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788869807.831865:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788869807.831879:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788869807.831916:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788869807.831929:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788869807.831943:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788869807.831956:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788869807.831968:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788869807.831982:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788869807.831995:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788869807.832008:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788869807.832022:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788869807.832036:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788869807.832047:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788869807.832058:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788869807.832083:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788869807.832097:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788869807.832108:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788869807.832120:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788869807.832131:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788869807.832142:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788869807.832154:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788869807.832165:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788869807.832176:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788869807.832187:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788869807.832200:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788869807.832212:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788869807.832225:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788869807.832237:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788869807.832248:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788869807.832452:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788869807.832481:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788869807.832497:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788869807.832510:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788869807.832525:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788869807.832537:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788869807.832561:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788869807.832575:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788869807.832588:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788869807.832602:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788869807.832617:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788869807.832664:0:18662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554761472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869807.832727:0:18662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869807.835518:0:18662:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8b72780 going to sleep for 11 seconds 00000100:00100000:0.0:1788869807.838172:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554761472 00000100:00100000:0.0:1788869807.838185:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554761472 00000100:00100000:1.0:1788869807.840989:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788869807.841449:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:18662:x1875765554761472:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869807.841634:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:18662:x1875765554761472:12345-0@lo:502:mount.lustre.0 Request processed in 633us (8907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869807.841703:0:18662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554761472:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788869807.841935:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788869807.841965:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788869807.842002:0:18662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554761600:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869807.842047:0:18662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869807.842078:0:18662:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8860c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788869807.842096:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554761600 00000100:00100000:3.0:1788869807.842102:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554761600 00000100:00100000:1.0:1788869807.846955:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788869807.847300:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788869807.847313:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:18662:x1875765554761600:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869807.847573:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:18662:x1875765554761600:12345-0@lo:502:mount.lustre.0 Request processed in 263us (5524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869807.847591:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788869807.847867:0:18662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554761600:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788869807.847954:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788869807.847967:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788869807.849474:0:18689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788869807.849492:0:18689:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99ffbcd13380) 00000020:00000080:0.0:1788869807.849516:0:18689:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788869807.849757:0:18689:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99fe81cb4800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788869807.849762:0:18689:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99fe81cb4800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788869807.849765:0:18689:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99fe81cb4800 3 00010000:00080000:0.0:1788869807.849792:0:18689:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ffb9899800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.130@tcp at head 00010000:00010000:0.0:1788869807.851371:0:18689:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1788869807.851457:0:18689:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788869807.851491:0:18689:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788869807.851501:0:18689:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbead52e175fc3f9f 00000100:00080000:0.0:1788869807.851510:0:18689:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788869807.851514:0:18689:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99ffb9899800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788869807.851545:0:18689:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe84024000 x1875765554761728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869807.851577:0:18689:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788869807.851706:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869807.851711:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788869807.851714:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869807.851717:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788869807.851736:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869807.851739:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788869807.851741:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869807.851743:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788869807.851771:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875765554761984:0@lo:400:kworker.0 00000100:00100000:1.0:1788869807.851835:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869807.851883:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869807.851890:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554761856:0@lo:400:kworker.0 00000100:00100000:1.0:1788869807.851916:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869807.851947:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554762112:0@lo:400:kworker.0 00000100:00100000:1.0:1788869807.851970:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869807.851986:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869807.851997:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554762240:0@lo:400:kworker.0 00000100:00100000:1.0:1788869807.852017:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869807.852048:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554761984 00000100:00100000:1.0:1788869807.852054:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554761984 00000100:00100000:1.0:1788869807.852087:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554762240 00000100:00100000:1.0:1788869807.852090:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554762240 00000100:00100000:1.0:1788869807.852107:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788869807.852116:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875765554761984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869807.852161:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875765554761984:12345-0@lo:400:kworker.0 Request processed in 46us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869807.852168:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788869807.852181:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788869807.852186:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554762240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869807.852225:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554762240:12345-0@lo:400:kworker.0 Request processed in 39us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869807.852231:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788869807.852249:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554761856 00000100:00100000:1.0:1788869807.852272:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554761856 00000100:00100000:1.0:1788869807.852291:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554762112 00000100:00100000:1.0:1788869807.852293:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554762112 00000100:00100000:1.0:1788869807.852303:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788869807.852308:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554761856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869807.852335:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554761856:12345-0@lo:400:kworker.0 Request processed in 27us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869807.852341:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788869807.852350:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788869807.852355:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554762112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869807.852382:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554762112:12345-0@lo:400:kworker.0 Request processed in 28us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869807.852388:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788869807.852425:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffbfb1ce00 x1875765554762240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869807.852438:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554762240:0@lo:400:kworker.0 00000100:00100000:1.0:1788869807.852446:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554762112:0@lo:400:kworker.0 00000100:00100000:1.0:1788869807.852467:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554761856:0@lo:400:kworker.0 00010000:00080000:1.0:1788869807.852475:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ffbfb1c000 x1875765554761984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869807.852483:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875765554761984:0@lo:400:kworker.0 00000100:00100000:2.0:1788869807.855148:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1875765554761728:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788869807.855227:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869807.855432:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554761728 00000100:00100000:1.0:1788869807.855442:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554761728 00000100:00100000:1.0:1788869807.855486:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869807.855493:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3615:x1875765554761728:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788869807.855521:0:17160:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:1.0:1788869807.855557:0:17160:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbead52e175fc3fa6 00000004:00100000:1.0:1788869807.855573:0:17160:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788869807.855604:0:17160:0:(import.c:65:import_set_state_nolock()) ffff99ffc10d8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869807.855651:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875765554761728:12345-0@lo:38:llog_process_th.0 Request processed in 157us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869807.855659:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788869807.855745:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99fe84024000 x1875765554761728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869807.855755:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788869807.855763:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788869807.855769:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788869807.855773:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788869807.855776:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffb9899800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788869807.855781:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1875765554761728:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1788869807.855945:0:18689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788869807.855959:0:18689:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff99ffbcd14d40) 00000020:00000080:0.0:1788869807.855976:0:18689:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1788869807.856135:0:18689:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99fe81cb4800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788869807.856140:0:18689:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99fe81cb4800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788869807.856143:0:18689:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99fe81cb4800 3 00010000:00080000:0.0:1788869807.856170:0:18689:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fe833dd800@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.130@tcp at head 00010000:00010000:2.0:1788869807.863905:0:18689:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1788869807.864015:0:18689:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788869807.864067:0:18689:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788869807.864081:0:18689:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xbead52e175fc3fb4 00000100:00080000:2.0:1788869807.864092:0:18689:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869807.864098:0:18689:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff99fe833dd800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788869807.864133:0:18689:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe84019500 x1875765554762368/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869807.864165:0:18689:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788869807.864211:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1875765554762368:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788869807.864311:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869807.864922:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554762368 00000100:00100000:1.0:1788869807.864931:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554762368 00000100:00100000:1.0:1788869807.864981:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788869807.864989:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1875765554762368:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788869807.865016:0:17162:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:1.0:1788869807.865059:0:17162:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xbead52e175fc3fbb 00000004:00100000:1.0:1788869807.865075:0:17162:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788869807.865107:0:17162:0:(import.c:65:import_set_state_nolock()) ffff99ffc10dc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869807.865176:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875765554762368:12345-0@lo:38:llog_process_th.0 Request processed in 186us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869807.865183:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788869807.865211:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869807.865215:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788869807.865218:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869807.865221:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788869807.865225:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869807.865228:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788869807.865230:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869807.865232:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:3.0:1788869807.865730:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99fe84019500 x1875765554762368/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869807.865742:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788869807.865759:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788869807.865767:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788869807.865771:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788869807.865773:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99fe833dd800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788869807.865779:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1875765554762368:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788869807.866715:0:18689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788869807.872399:0:18662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788869807.872447:0:18662:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788869807.872475:0:18662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f800/0xbead52e175fc3f8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3f91 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869807.872488:0:18662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f800/0xbead52e175fc3f8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3f91 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788869807.872545:0:18662:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788869807.872547:0:18662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788869807.872548:0:18662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869807.872550:0:18662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869807.872551:0:18662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869807.872553:0:18662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869807.872554:0:18662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869807.872556:0:18662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869807.872558:0:18662:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788869807.872562:0:18662:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788869807.872564:0:18662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788869807.872566:0:18662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788869807.872567:0:18662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869807.872568:0:18662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869807.872569:0:18662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869807.872570:0:18662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869807.872572:0:18662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869807.872573:0:18662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869807.872574:0:18662:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788869807.872605:0:18662:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788869807.872629:0:18662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554762496:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788869807.872707:0:18662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869807.872741:0:18662:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8b72e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869807.872797:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554762496 00000100:00100000:1.0:1788869807.872805:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554762496 00000100:00100000:1.0:1788869807.872867:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788869807.872877:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:18662:x1875765554762496:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788869807.872908:0:17155:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788869807.872922:0:17155:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788869807.877457:0:17155:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788869807.877469:0:17155:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788869807.877668:0:17176:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788869807.877672:0:17176:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788869807.877693:0:17176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffbfb05400/0xbead52e175fc3fc2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.877713:0:17176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ff80031c00/0xbead52e175fc3f0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3f05 expref: 21 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.877721:0:17176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fe823c1a00/0xbead52e175fc3f1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3f13 expref: 21 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.877730:0:17176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffbfb05400/0xbead52e175fc3fc2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.877771:0:17176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fe823c1a00/0xbead52e175fc3f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc3f13 expref: 21 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.877783:0:17176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fe823c1a00/0xbead52e175fc3f1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc3f13 expref: 21 pid: 17154 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869807.877798:0:17176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84025880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17176:1875765554762624:0@lo:104: 00000100:00100000:0.0:1788869807.877870:0:17176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788869807.877929:0:17176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ff80031c00/0xbead52e175fc3f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc3f05 expref: 21 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.877938:0:17176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ff80031c00/0xbead52e175fc3f0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc3f05 expref: 21 pid: 17154 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869807.877946:0:17176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84025f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17176:1875765554762752:0@lo:104: 00000100:00100000:0.0:1788869807.877971:0:17176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869807.877996:0:17176:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84fad840 going to sleep for 11 seconds 00000100:00100000:3.0:1788869807.878063:0:17144:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788869807.878083:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554762624 00000100:00100000:3.0:1788869807.878092:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554762624 00000100:00100000:2.0:1788869807.878124:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554762752 00000100:00100000:3.0:1788869807.878133:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869807.878135:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554762752 00000100:00100000:3.0:1788869807.878147:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84025c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+4:17176:x1875765554762624:12345-0@lo:104: 00010000:00010000:3.0:1788869807.878161:0:17144:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05200/0xbead52e175fc3f13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3f1a expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869807.878233:0:17144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788869807.878240:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84025c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+4:17176:x1875765554762624:12345-0@lo:104: Request processed in 97us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869807.878246:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:18662:x1875765554762496:12345-0@lo:253:mount.lustre.0 Request processed in 5369us (5536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869807.878271:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869807.878286:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788869807.878292:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788869807.878301:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+3:17176:x1875765554762752:12345-0@lo:104: 00010000:00010000:3.0:1788869807.878309:0:17144:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04400/0xbead52e175fc3f05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3f0c expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869807.878349:0:17144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788869807.878354:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+3:17176:x1875765554762752:12345-0@lo:104: Request processed in 56us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869807.878367:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869807.878384:0:17176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84025880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17176:1875765554762624:0@lo:104: 00000100:00100000:2.0:1788869807.878396:0:17176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84025f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17176:1875765554762752:0@lo:104: 00010000:00010000:2.0:1788869807.878415:0:17176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffbfb05400/0xbead52e175fc3fc2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869807.878447:0:18662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:18662:1875765554762496:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788869807.878457:0:18662:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788869807.878461:0:18662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788869807.878463:0:18662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788869807.878464:0:18662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869807.878465:0:18662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869807.878466:0:18662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869807.878467:0:18662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869807.878468:0:18662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869807.878470:0:18662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869807.878471:0:18662:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788869807.878481:0:18662:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788869807.879078:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869807.879086:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05200/0xbead52e175fc3f13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3f1a expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879095:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05200 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:0.0:1788869807.879099:0:17149:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05200/0xbead52e175fc3f13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc3f1a expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879109:0:17149:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05200/0xbead52e175fc3f13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc3f1a expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869807.879117:0:17149:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05200/0xbead52e175fc3f13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc3f1a expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869807.879123:0:17149:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869807.879163:0:17149:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05200/0xbead52e175fc3f13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3f1a expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879170:0:17149:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869807.879199:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05200/0xbead52e175fc3f13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3f1a expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879206:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffbfb05200/0xbead52e175fc3f13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3f1a expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879218:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869807.879221:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04400/0xbead52e175fc3f05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3f0c expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879228:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:0.0:1788869807.879231:0:17149:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04400/0xbead52e175fc3f05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc3f0c expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879238:0:17149:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04400/0xbead52e175fc3f05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc3f0c expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869807.879245:0:17149:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04400/0xbead52e175fc3f05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc3f0c expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869807.879277:0:17149:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869807.879293:0:17149:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04400/0xbead52e175fc3f05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3f0c expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879299:0:17149:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869807.879305:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04400/0xbead52e175fc3f05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3f0c expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879312:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04400/0xbead52e175fc3f05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3f0c expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879335:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869807.879337:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869807.879338:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869807.879353:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3616:1875765554762880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869807.879393:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869807.879428:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869807.879435:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3616:1875765554763008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869807.879459:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869807.879489:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554762880 00000100:00100000:0.0:1788869807.879494:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554762880 00010000:00010000:0.0:1788869807.879513:0:17146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fe823c1a00/0xbead52e175fc3f1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3f13 expref: 21 pid: 17154 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869807.879535:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554763008 00000100:00100000:0.0:1788869807.879538:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554763008 00010000:00010000:0.0:1788869807.879550:0:17146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ff80031c00/0xbead52e175fc3f0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3f05 expref: 22 pid: 17154 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869807.879571:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869807.879579:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84024a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+22:3616:x1875765554762880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869807.879590:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869807.879597:0:17146:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fe823c1a00/0xbead52e175fc3f1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3f13 expref: 22 pid: 17154 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879608:0:17146:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fe823c1a00/0xbead52e175fc3f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc3f13 expref: 22 pid: 17154 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879622:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fe823c1a00/0xbead52e175fc3f1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc3f13 expref: 22 pid: 17154 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879710:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869807.879746:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84024a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:3616:x1875765554762880:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869807.879753:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869807.879769:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788869807.879776:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+20:3616:x1875765554763008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869807.879782:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869807.879786:0:17146:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ff80031c00/0xbead52e175fc3f0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3f05 expref: 20 pid: 17154 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879795:0:17146:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ff80031c00/0xbead52e175fc3f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc3f05 expref: 20 pid: 17154 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879805:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff80031c00/0xbead52e175fc3f0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc3f05 expref: 20 pid: 17154 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879816:0:17146:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffbfb05400/0xbead52e175fc3fc2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879824:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffbfb05400/0xbead52e175fc3fc2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788869807.879837:0:17146:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007236943s 00010000:00010000:0.0:1788869807.879841:0:17146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffbfb05400/0xbead52e175fc3fc2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879859:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffbfb05400/0xbead52e175fc3fc2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879875:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffbfb05400/0xbead52e175fc3fc2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879882:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffbfb05400/0xbead52e175fc3fc2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879887:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05400 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869807.879891:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffbfb05400/0xbead52e175fc3fc2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879898:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffbfb05400/0xbead52e175fc3fc2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879910:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffbfb05400/0xbead52e175fc3fc2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.879919:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869807.879943:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+19:3616:x1875765554763008:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869807.879950:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788869807.880002:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3616:1875765554763008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869807.880009:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3616:1875765554762880:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788869807.881499:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869807.881818:0:17176:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffbfb05400/0xbead52e175fc3fc2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869807.881832:0:17176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffbfb05400/0xbead52e175fc3fc2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869807.881840:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffbfb05400/0xbead52e175fc3fc2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1788869807.884190:0:18662:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788869807.888035:0:18662:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788869807.888047:0:18662:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788869807.888086:0:18662:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788869807.888138:0:18662:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788869807.888161:0:18662:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788869807.888180:0:18662:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788869807.889498:0:18662:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788869807.890209:0:18662:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788869807.970095:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788869808.694246:0:18743:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869808.694624:0:18743:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788869808.986011:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869809.056534:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788869809.056559:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554763136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869809.056634:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869809.056693:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554763136 00000100:00100000:0.0:1788869809.056701:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554763136 00000100:00100000:0.0:1788869809.056749:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788869809.056758:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554763136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869809.056794:0:17165:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788869809.056852:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554763136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869809.056859:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788869809.056906:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554763136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869809.058832:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554763264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869809.059895:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869809.064955:0:17901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554763264 00000100:00100000:2.0:1788869809.064976:0:17901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554763264 00000100:00100000:2.0:1788869809.065048:0:17901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788869809.065060:0:17901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554763264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869809.065101:0:17901:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788869809.065208:0:17901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554763264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (5316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869809.065216:0:17901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788869809.065302:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554763264:0@lo:41:osp-pre-0-1.0 10000000:01000000:2.0:1788869809.560322:0:17157:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788869809.560330:0:17157:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ffbf9b2000 from 9 10000000:01000000:2.0:1788869809.560335:0:17157:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788869809.560377:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99fe823c1600/0xbead52e175fc3fc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869809.560388:0:17157:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99fe823c1600/0xbead52e175fc3fc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869809.560399:0:17157:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99fe823c1600/0xbead52e175fc3fc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869809.560425:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554763392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869809.560511:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869809.560556:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb95adb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869809.562228:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554763392 00000100:00100000:0.0:1788869809.562242:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554763392 00000100:00100000:0.0:1788869809.562322:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788869809.562333:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+19:17157:x1875765554763392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869809.562349:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869809.562368:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffbfb04e00/0xbead52e175fc3fd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc3fc9 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869809.562396:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffbfb04e00/0xbead52e175fc3fd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc3fc9 expref: 20 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869809.562407:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffbfb04e00/0xbead52e175fc3fd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3fc9 expref: 20 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869809.562418:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04e00, rc 0) 00000100:00100000:0.0:1788869809.562486:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+20:17157:x1875765554763392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869809.562509:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788869809.562570:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554763392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869809.562587:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99fe823c1600/0xbead52e175fc3fc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3fd0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869809.562597:0:17157:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99fe823c1600/0xbead52e175fc3fc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc3fd0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869809.562661:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84024380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554763520:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788869809.562700:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869809.562727:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd000 going to sleep for 11 seconds 00000100:00100000:0.0:1788869809.562740:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554763520 00000100:00100000:0.0:1788869809.562743:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554763520 00000100:00100000:0.0:1788869809.562765:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788869809.562771:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83941050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+20:17157:x1875765554763520:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788869809.562784:0:17155:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788869809.562812:0:17155:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788869809.562825:0:17155:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788869809.562907:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83941050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+20:17157:x1875765554763520:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869809.562914:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788869809.562949:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84024380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554763520:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788869809.563013:0:17157:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788869809.563021:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99fe823c1600/0xbead52e175fc3fc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3fd0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869809.563037:0:17157:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99fe823c1600/0xbead52e175fc3fc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3fd0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869809.563046:0:17157:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788869809.563049:0:17157:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99fe81f16800 from 9 10000000:01000000:0.0:1788869809.563051:0:17157:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788869809.563071:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04a00/0xbead52e175fc3fd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869809.563079:0:17157:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04a00/0xbead52e175fc3fd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869809.563087:0:17157:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04a00/0xbead52e175fc3fd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869809.563099:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84024380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554763648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869809.563124:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869809.563141:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff98dcd000 going to sleep for 11 seconds 00000100:00100000:0.0:1788869809.563151:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554763648 00000100:00100000:0.0:1788869809.563154:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554763648 00000100:00100000:0.0:1788869809.563174:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788869809.563179:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+20:17157:x1875765554763648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869809.563187:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869809.563195:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffbfb05e00/0xbead52e175fc3fde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc3fd7 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869809.563209:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffbfb05e00/0xbead52e175fc3fde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc3fd7 expref: 21 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869809.563227:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffbfb05e00/0xbead52e175fc3fde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3fd7 expref: 21 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869809.563233:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb05e00, rc 0) 00000100:00100000:0.0:1788869809.563277:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:17157:x1875765554763648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869809.563283:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788869809.563312:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84024380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554763648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869809.563325:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04a00/0xbead52e175fc3fd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3fde expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869809.563333:0:17157:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04a00/0xbead52e175fc3fd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc3fde expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869809.563372:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84024380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554763776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788869809.563399:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869809.563427:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae6dca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788869809.563578:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554763776 00000100:00100000:2.0:1788869809.563582:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554763776 00000100:00100000:2.0:1788869809.563619:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788869809.563626:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe832f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:17157:x1875765554763776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788869809.563638:0:17153:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788869809.563649:0:17153:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788869809.563652:0:17153:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788869809.563714:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe832f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:17157:x1875765554763776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 88us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869809.563721:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788869809.563790:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84024380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554763776:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788869809.563838:0:17157:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788869809.563844:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04a00/0xbead52e175fc3fd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3fde expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869809.563851:0:17157:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04a00/0xbead52e175fc3fd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3fde expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869810.015464:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869811.034095:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869812.058452:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869812.446978:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788869813.086090:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788869813.145085:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869813.145093:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869813.145096:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869813.145099:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869813.145127:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869813.145131:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869813.145133:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869813.145136:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788869813.145176:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554764160:0@lo:400:kworker.0 00000100:00100000:3.0:1788869813.145247:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869813.145335:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554764672:0@lo:400:kworker.0 00000100:00100000:3.0:1788869813.145359:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869813.145383:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869813.145390:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554764288:0@lo:400:kworker.0 00000100:00100000:3.0:1788869813.145413:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869813.145451:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554764160 00000100:00100000:3.0:1788869813.145457:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554764160 00000100:00100000:3.0:1788869813.145495:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554764672 00000100:00100000:3.0:1788869813.145533:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554764672 00000100:00100000:3.0:1788869813.145561:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869813.145568:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554764160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869813.145615:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554764160:12345-0@lo:400:kworker.0 Request processed in 47us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869813.145623:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869813.145639:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869813.145645:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554764672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869813.145823:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554764672:12345-0@lo:400:kworker.0 Request processed in 178us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869813.145830:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869813.145853:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554764288 00000100:00100000:3.0:1788869813.145857:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554764288 00000100:00100000:3.0:1788869813.145878:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788869813.145884:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554764288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869813.145913:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554764288:12345-0@lo:400:kworker.0 Request processed in 29us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869813.145919:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788869813.145953:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554764288:0@lo:400:kworker.0 00010000:00080000:3.0:1788869813.145977:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffae6ad500 x1875765554764160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869813.145988:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554764160:0@lo:400:kworker.0 00010000:00080000:3.0:1788869813.145997:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffbfb11180 x1875765554764672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869813.146005:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554764672:0@lo:400:kworker.0 00000100:00100000:0.0:1788869813.146393:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3616:1875765554763904:0@lo:400:kworker.0 00000100:00100000:0.0:1788869813.146440:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869813.146484:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554764416:0@lo:400:kworker.0 00000100:00100000:0.0:1788869813.146512:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869813.146529:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788869813.146535:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554764032:0@lo:400:kworker.0 00000100:00100000:0.0:1788869813.146559:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869813.146577:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875765554764544:0@lo:400:kworker.0 00000100:00100000:0.0:1788869813.146601:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788869813.146638:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869813.146651:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554764032 00000100:00100000:0.0:1788869813.146655:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554764032 00000100:00100000:0.0:1788869813.146680:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869813.146686:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554764032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869813.146736:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554764032:12345-0@lo:400:kworker.0 Request processed in 50us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869813.146743:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869813.146779:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554764032:0@lo:400:kworker.0 00000100:00100000:3.0:1788869813.146893:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554764416 00000100:00100000:3.0:1788869813.146898:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554764416 00000100:00100000:3.0:1788869813.146931:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554764544 00000100:00100000:3.0:1788869813.146934:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554764544 00000100:00100000:3.0:1788869813.146958:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869813.146964:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554764416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869813.146999:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554764416:12345-0@lo:400:kworker.0 Request processed in 35us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869813.147005:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869813.147015:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788869813.147021:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875765554764544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869813.147045:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875765554764544:12345-0@lo:400:kworker.0 Request processed in 25us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869813.147050:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788869813.147063:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788869813.147081:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffbfb10000 x1875765554764544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869813.147090:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875765554764544:0@lo:400:kworker.0 00010000:00080000:3.0:1788869813.147100:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffbfb12d80 x1875765554764416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869813.147115:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554764416:0@lo:400:kworker.0 00000100:00100000:2.0:1788869813.147180:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554763904 00000100:00100000:2.0:1788869813.147185:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554763904 00000100:00100000:2.0:1788869813.147221:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788869813.147228:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:3616:x1875765554763904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869813.147283:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:3616:x1875765554763904:12345-0@lo:400:kworker.0 Request processed in 56us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869813.147290:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788869813.147326:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3616:1875765554763904:0@lo:400:kworker.0 00010000:00010000:1.0:1788869814.108086:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869814.168435:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554764800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869814.168509:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869814.168584:0:17901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554764800 00000100:00100000:0.0:1788869814.168591:0:17901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554764800 00000100:00100000:0.0:1788869814.168638:0:17901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788869814.168647:0:17901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554764800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869814.168678:0:17901:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788869814.168722:0:17901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554764800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869814.168747:0:17901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788869814.168795:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554764800:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1788869814.170517:0:19032:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788869814.175033:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554764928:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869814.175111:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869814.175196:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554764928 00000100:00100000:0.0:1788869814.175205:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554764928 00000100:00100000:0.0:1788869814.175281:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788869814.175292:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554764928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788869814.175327:0:17166:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788869814.183991:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554764928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8691us (8869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869814.184007:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788869814.187359:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554764928:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788869815.129413:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788869815.239339:0:19085:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788869815.240887:0:19085:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1788869815.349015:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788869816.153475:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788869816.237602:0:19135:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869816.237912:0:19135:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788869817.176391:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869818.138208:0:3615:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869803/real 1788869803] req@ffff99fe8401bb80 x1875765554758016/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869818 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869818.138238:0:3615:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99fe8401bb80 x1875765554758016/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869818 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869818.138248:0:3615:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869803/real 1788869803] req@ffff99fe8401b100 x1875765554758144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869818 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869818.138285:0:3615:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99fe8401b100 x1875765554758144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869818 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788869818.138303:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99fe83b0c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788869818.138322:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788869818.138326:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554758016:0@lo:8:kworker.0 00000100:00080000:3.0:1788869818.138330:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ff87c82800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788869818.138335:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788869818.138338:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554758144:0@lo:8:kworker.0 00000100:00080000:2.0:1788869818.138499:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869818.138504:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788869818.138507:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869818.138510:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788869818.138523:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869818.138526:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788869818.138529:0:36:0:(import.c:65:import_set_state_nolock()) ffff99fe83b0c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869818.138534:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 421 00000100:00080000:2.0:1788869818.138539:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788869818.138554:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99fe83b0c000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788869818.138574:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe84018000 x1875765554765568/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869818.138589:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869818.138592:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788869818.138593:0:36:0:(import.c:65:import_set_state_nolock()) ffff99ff87c82800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869818.138596:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 421 00000100:00080000:2.0:1788869818.138598:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788869818.138601:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99ff87c82800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788869818.138611:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe84018e00 x1875765554765696/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788869818.138648:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554765568:0@lo:8:kworker.0 00000100:00100000:2.0:1788869818.138724:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869818.138766:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554765696:0@lo:8:kworker.0 00000100:00100000:2.0:1788869818.138787:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869818.138863:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3617:1875765554765056:0@lo:400:kworker.0 00000100:00100000:0.0:1788869818.138896:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869818.138923:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554765824:0@lo:400:kworker.0 00000100:00100000:0.0:1788869818.138946:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869818.138967:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869818.138973:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554765440:0@lo:400:kworker.0 00000100:00100000:0.0:1788869818.138996:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869818.139019:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554765184:0@lo:400:kworker.0 00000100:00100000:0.0:1788869818.139042:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869818.139060:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554765952:0@lo:400:kworker.0 00000100:00100000:0.0:1788869818.139081:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869818.139097:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788869818.139103:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554765312:0@lo:400:kworker.0 00000100:00100000:0.0:1788869818.139132:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869818.139150:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554766080:0@lo:400:kworker.0 00000100:00100000:0.0:1788869818.139174:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869818.139206:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554765568 00000100:00100000:0.0:1788869818.139212:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554765568 00000100:00100000:0.0:1788869818.139237:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554765696 00000100:00100000:0.0:1788869818.139239:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554765696 00000100:00100000:0.0:1788869818.139275:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869818.139283:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1875765554765568:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788869818.139311:0:18667:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:0.0:1788869818.139337:0:18667:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbead52e175fc3fe5 00002000:00100000:0.0:1788869818.139351:0:18667:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff99fe833db000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788869818.139355:0:18667:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1788869818.139357:0:18667:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788869818.139529:0:18667:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788869818.139552:0:18667:0:(import.c:65:import_set_state_nolock()) ffff99fe833d9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869818.139597:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3615:x1875765554765568:12345-0@lo:8:kworker.0 Request processed in 314us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869818.139604:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869818.139621:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869818.139625:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1875765554765696:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788869818.139636:0:18667:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788869818.140576:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554765056 00000100:00100000:2.0:1788869818.140584:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554765056 00000100:00100000:2.0:1788869818.140631:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788869818.140639:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:3617:x1875765554765056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869818.140713:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:3617:x1875765554765056:12345-0@lo:400:kworker.0 Request processed in 75us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869818.140720:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:2.0:1788869818.140768:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe84018000 x1875765554765568/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869818.140778:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788869818.140796:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788869818.140804:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788869818.140809:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788869818.140812:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99fe83b0c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788869818.140825:0:3615:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:2.0:1788869818.140831:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554765568:0@lo:8:kworker.0 00000004:00080000:2.0:1788869818.140854:0:17902:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788869818.140908:0:17903:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788869818.140927:0:17903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb10000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17903:1875765554766336:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788869818.140927:0:17902:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 436067674413ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788869818.140933:0:17902:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788869818.140956:0:17903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869818.140969:0:17903:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8cbbc480 going to sleep for 11 seconds 00000100:00100000:3.0:1788869818.140981:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554766208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869818.141011:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869818.141043:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554766208 00000100:00100000:3.0:1788869818.141047:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554766208 00000100:00100000:3.0:1788869818.141109:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869818.141116:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1875765554766208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869818.141135:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788869818.141303:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1875765554766208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 186us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869818.141310:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788869818.141328:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869818.141350:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3617:1875765554765056:0@lo:400:kworker.0 00010000:00080000:2.0:1788869818.144652:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffbfb12d80 x1875765554766208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869818.144692:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554766208:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869818.146137:0:18669:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788869818.146153:0:18669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788869818.148242:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554766336 00000100:00100000:1.0:1788869818.148270:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554766336 00000100:00100000:2.0:1788869818.148466:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869818.148477:0:19213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17903:x1875765554766336:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788869818.149404:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554765440 00000100:00100000:1.0:1788869818.149412:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554765440 00000100:00100000:1.0:1788869818.149550:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554765184 00000100:00100000:1.0:1788869818.149555:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554765184 00000100:00100000:3.0:1788869818.150678:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788869818.150694:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554765440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869818.150790:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554765440:12345-0@lo:400:kworker.0 Request processed in 101us (11791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869818.150797:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788869818.150819:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788869818.150826:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554765184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869818.150863:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554765184:12345-0@lo:400:kworker.0 Request processed in 38us (11820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869818.150870:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788869818.150928:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554765184:0@lo:400:kworker.0 00000100:00100000:3.0:1788869818.150963:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554765440:0@lo:400:kworker.0 00000100:00100000:1.0:1788869818.151706:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554765824 00000100:00100000:1.0:1788869818.151715:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554765824 00000100:00100000:1.0:1788869818.151741:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554765952 00000100:00100000:1.0:1788869818.151743:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554765952 00000100:00100000:1.0:1788869818.151763:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554765312 00000100:00100000:1.0:1788869818.151765:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554765312 00000100:00100000:1.0:1788869818.151773:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554766080 00000100:00100000:1.0:1788869818.151776:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554766080 00000100:00100000:1.0:1788869818.151788:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788869818.151793:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554765824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869818.151843:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875765554765824:12345-0@lo:400:kworker.0 Request processed in 49us (12895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869818.151850:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788869818.151863:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788869818.151869:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554765952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869818.151903:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554765952:12345-0@lo:400:kworker.0 Request processed in 34us (12821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869818.151909:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788869818.151920:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788869818.151938:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554765312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869818.151969:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554765312:12345-0@lo:400:kworker.0 Request processed in 31us (12835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869818.151975:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788869818.151987:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788869818.151993:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554766080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869818.152016:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554766080:12345-0@lo:400:kworker.0 Request processed in 24us (12842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869818.152022:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788869818.155063:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1875765554765696:12345-0@lo:8:kworker.0 Request processed in 15429us (16267us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788869818.155079:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788869818.155227:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ff87c82800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869818.155233:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788869818.155237:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554765696:0@lo:8:kworker.0 00000100:00080000:1.0:1788869818.156535:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869818.156543:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:2.0:1788869818.156626:0:19213:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788869818.156633:0:19213:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788869818.156727:0:19213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17903:x1875765554766336:12345-0@lo:7:osp-pre-0-1.0 Request processed in 8250us (15767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869818.156736:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788869818.156883:0:17903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffbfb10000 x1875765554766336/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788869834 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869818.156897:0:17903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb10000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17903:1875765554766336:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788869818.156911:0:17903:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788869818.156950:0:17903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17903:1875765554766464:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788869818.156983:0:17903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869818.157010:0:17903:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89a98480 going to sleep for 11 seconds 00000100:00100000:2.0:1788869818.157082:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554766464 00000100:00100000:2.0:1788869818.157090:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554766464 00000100:00100000:2.0:1788869818.157133:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788869818.157141:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17903:x1875765554766464:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788869818.157178:0:18669:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1788869818.157211:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17903:x1875765554766464:12345-0@lo:5:osp-pre-0-1.0 Request processed in 70us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869818.157218:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788869818.157247:0:17903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ffbfb1ea00 x1875765554766464/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869834 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869818.157280:0:17903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17903:1875765554766464:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788869818.157290:0:17903:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788869818.157314:0:17903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17903:1875765554766592:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788869818.157339:0:17903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869818.157354:0:17903:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89c61240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869818.157367:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554766592 00000100:00100000:2.0:1788869818.157370:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554766592 00000100:00100000:2.0:1788869818.157389:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869818.157394:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17903:x1875765554766592:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788869818.157417:0:18667:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:1.0:1788869818.157567:0:17893:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00080000:3.0:1788869818.160068:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe8401b480 x1875765554765824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869818.160096:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875765554765824:0@lo:400:kworker.0 00010000:00080000:3.0:1788869818.160140:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe8401bb80 x1875765554765312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869818.160150:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554765312:0@lo:400:kworker.0 00010000:00080000:3.0:1788869818.160163:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe84018380 x1875765554766080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869818.160172:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554766080:0@lo:400:kworker.0 00010000:00080000:3.0:1788869818.160185:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe84019500 x1875765554765952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869818.160192:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554765952:0@lo:400:kworker.0 00000001:00080000:2.0:1788869818.177622:0:18663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788869818.177870:0:18663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788869818.178077:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17903:x1875765554766592:12345-0@lo:5:osp-pre-0-1.0 Request processed in 20677us (20732us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788869818.178089:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788869818.178191:0:17903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe8397e680 x1875765554766592/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869834 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869818.178205:0:17903:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788869818.178212:0:17903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17903:1875765554766592:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788869818.178232:0:17903:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1788869818.178817:0:17903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17903:1875765554766720:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788869818.178882:0:17903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869818.178920:0:17903:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89c61240 going to sleep for 11 seconds 00000100:00100000:0.0:1788869818.179404:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554766720 00000100:00100000:0.0:1788869818.179418:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554766720 00000100:00100000:0.0:1788869818.179493:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869818.179505:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17903:x1875765554766720:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788869818.182058:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17903:x1875765554766720:12345-0@lo:900:osp-pre-0-1.0 Request processed in 2546us (3165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869818.182073:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788869818.182280:0:17903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe8397e680 x1875765554766720/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788869834 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869818.182297:0:17903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17903:1875765554766720:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1788869818.202807:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869819.238939:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869819.288467:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554766848:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869819.288544:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869819.288586:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554766848 00000100:00100000:0.0:1788869819.288604:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554766848 00000100:00100000:0.0:1788869819.288657:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788869819.288775:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554766848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869819.288813:0:17165:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788869819.288869:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554766848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 203us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869819.288877:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788869819.289030:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554766848:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869819.293120:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869819.293146:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554766976:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869819.293224:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869819.293293:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554766976 00000100:00100000:0.0:1788869819.293301:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554766976 00000100:00100000:0.0:1788869819.293347:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788869819.293356:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554766976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788869819.293390:0:17166:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788869819.293507:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554766976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 152us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869819.293515:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788869819.295465:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554766976:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788869820.249823:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869821.272431:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869822.297540:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869822.682081:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1788869822.717086:0:19481:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788869822.717091:0:19481:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788869822.717092:0:19481:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788869822.717203:0:19481:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99ffbab91000 00000020:01000004:0.0:1788869822.717218:0:19481:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788869822.717232:0:19481:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788869822.717303:0:19481:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99ffbcd10000) 00000020:00000080:0.0:1788869822.717322:0:19481:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788869822.776058:0:19481:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788869822.781048:0:19481:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788869822.781348:0:19481:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788869822.781780:0:19481:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788869822.782236:0:19481:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788869822.782475:0:19481:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788869822.782731:0:19481:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1788869822.784223:0:19481:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788869822.784552:0:19481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788869822.784566:0:19481:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788869822.784590:0:19481:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbead52e175fc3ff3 00000020:01000004:2.0:1788869822.784597:0:19481:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788869822.784621:0:19481:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.130@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788869822.784624:0:19481:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788869822.784630:0:19481:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788869822.784660:0:19481:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788869822.784665:0:19481:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788869822.800157:0:19481:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788869822.800199:0:19481:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.130@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788869822.800204:0:19481:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788869822.800206:0:19481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788869822.800207:0:19481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869822.800208:0:19481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869822.800209:0:19481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869822.800210:0:19481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869822.800212:0:19481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869822.800214:0:19481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869822.800215:0:19481:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788869822.800219:0:19481:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788869822.800227:0:19481:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788869822.800228:0:19481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788869822.800229:0:19481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869822.800230:0:19481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869822.800231:0:19481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869822.800231:0:19481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869822.800232:0:19481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869822.800233:0:19481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869822.800234:0:19481:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788869822.800772:0:19481:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788869822.800922:0:19481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554767104:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788869822.801001:0:19481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869822.801086:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554767104 00000100:00100000:3.0:1788869822.801094:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554767104 00000100:00100000:3.0:1788869822.801203:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788869822.801214:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:19481:x1875765554767104:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788869822.801248:0:17153:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788869822.801271:0:17153:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788869822.801277:0:17153:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788869822.801739:0:19481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff87eeca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869822.801768:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:19481:x1875765554767104:12345-0@lo:253:mount.lustre.0 Request processed in 556us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869822.801776:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788869822.801780:0:19481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554767104:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788869822.801791:0:19481:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788869822.801794:0:19481:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788869822.801796:0:19481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788869822.801797:0:19481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869822.801799:0:19481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869822.801800:0:19481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869822.801801:0:19481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869822.801803:0:19481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869822.801805:0:19481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869822.801806:0:19481:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788869822.801827:0:19481:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ffbab91000 from lustre-OST0001 10000000:01000000:2.0:1788869822.801856:0:19481:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788869822.801859:0:19481:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788869822.801867:0:19481:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99ffbf908000 local copy 00010000:00010000:2.0:1788869822.801877:0:19481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99fe823c0800/0xbead52e175fc3d0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3d14 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869822.801976:0:19481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554767232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869822.802009:0:19481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869822.802032:0:19481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff87eec9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869822.802069:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554767232 00000100:00100000:0.0:1788869822.802075:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554767232 00000100:00100000:0.0:1788869822.802112:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788869822.802120:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:19481:x1875765554767232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869822.802196:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:19481:x1875765554767232:12345-0@lo:501:mount.lustre.0 Request processed in 76us (186us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788869822.802204:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788869822.804013:0:19481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554767232:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788869822.804035:0:19481:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788869822.804613:0:19481:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788869822.804624:0:19481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99fe823c0800/0xbead52e175fc3d0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3d14 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869822.804640:0:19481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99fe823c0800/0xbead52e175fc3d0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc3d14 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869822.804679:0:19481:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ffbab91000 10000000:01000000:1.0:1788869822.804763:0:19481:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788869822.804770:0:19481:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788869822.804776:0:19481:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788869822.804780:0:19481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788869822.804784:0:19481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788869822.804996:0:19481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff80030a00/0xbead52e175fc3ffa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.805006:0:19481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ff80030a00/0xbead52e175fc3ffa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.805019:0:19481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ff80030a00/0xbead52e175fc3ffa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869822.805043:0:19481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554767360:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788869822.805138:0:19481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869822.805280:0:19481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c436c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869822.805582:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554767360 00000100:00100000:3.0:1788869822.805590:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554767360 00000100:00100000:1.0:1788869822.805773:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788869822.805783:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:19481:x1875765554767360:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869822.805807:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869822.805829:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff80031c00/0xbead52e175fc4001 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc3ffa expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.805869:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff80031c00/0xbead52e175fc4001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc3ffa expref: 22 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.805881:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff80031c00/0xbead52e175fc4001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3ffa expref: 22 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.805890:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80031c00, rc 0) 00000100:00100000:1.0:1788869822.805944:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+22:19481:x1875765554767360:12345-0@lo:101:mount.lustre.0 Request processed in 161us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869822.805951:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788869822.806028:0:19481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554767360:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869822.806046:0:19481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ff80030a00/0xbead52e175fc3ffa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc4001 expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869822.806055:0:19481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ff80030a00/0xbead52e175fc3ffa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc4001 expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869822.807176:0:19481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788869822.808162:0:19481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788869822.811097:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788869822.811155:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788869822.811172:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788869822.811186:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788869822.811201:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788869822.811231:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788869822.811290:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788869822.811297:0:19481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788869822.811632:0:19481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554767488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869822.811701:0:19481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869822.811821:0:19481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869822.812031:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554767488 00000100:00100000:3.0:1788869822.812039:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554767488 00000100:00100000:3.0:1788869822.812138:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788869822.812148:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+22:19481:x1875765554767488:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869822.812341:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+22:19481:x1875765554767488:12345-0@lo:501:mount.lustre.0 Request processed in 194us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869822.812348:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788869822.812494:0:19481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554767488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869822.812526:0:19481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554767616:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869822.812566:0:19481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869822.813036:0:19481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869822.813111:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554767616 00000100:00100000:0.0:1788869822.813117:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554767616 00000100:00100000:0.0:1788869822.813143:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788869822.813150:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+22:19481:x1875765554767616:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869822.814523:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+22:19481:x1875765554767616:12345-0@lo:503:mount.lustre.0 Request processed in 1368us (1950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869822.814532:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788869822.814645:0:19481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554767616:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788869822.815085:0:19481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788869822.815164:0:19481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554767744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869822.815216:0:19481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869822.815249:0:19481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869822.815541:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554767744 00000100:00100000:3.0:1788869822.815547:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554767744 00000100:00100000:3.0:1788869822.815591:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788869822.815600:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+22:19481:x1875765554767744:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869822.816247:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+22:19481:x1875765554767744:12345-0@lo:502:mount.lustre.0 Request processed in 646us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869822.816291:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788869822.816640:0:19481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554767744:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788869822.816834:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788869822.816972:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788869822.816986:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788869822.816999:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788869822.817009:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788869822.817020:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788869822.817031:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788869822.817041:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788869822.817051:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788869822.817079:0:19481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554767872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869822.817120:0:19481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869822.817142:0:19481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869822.817233:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554767872 00000100:00100000:0.0:1788869822.817239:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554767872 00000100:00100000:0.0:1788869822.817311:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788869822.817319:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffa00a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+22:19481:x1875765554767872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869822.817521:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffa00a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+22:19481:x1875765554767872:12345-0@lo:502:mount.lustre.0 Request processed in 203us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869822.817529:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788869822.817620:0:19481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554767872:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869822.817660:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788869822.817668:0:19481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788869822.818641:0:19485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788869822.818651:0:19485:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788869822.818657:0:19485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869822.818660:0:19485:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788869822.818667:0:19485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788869822.818681:0:19485:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99ff956899c0) 00000020:00000080:2.0:1788869822.818706:0:19485:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788869822.818719:0:19485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788869822.819093:0:19485:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffbab91000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788869822.819105:0:19485:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788869822.819112:0:19485:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbead52e175fc400f 00010000:00010000:3.0:1788869822.824157:0:19485:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788869822.824818:0:19485:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1788869822.827507:0:19485:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788869822.830993:0:19485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788869822.831010:0:19485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869822.831016:0:19485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869822.831019:0:19485:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788869822.831024:0:19485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869822.831028:0:19485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869822.831037:0:19485:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788869822.831042:0:19485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788869822.831043:0:19485:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788869822.831046:0:19485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869822.831048:0:19485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869822.831050:0:19485:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788869822.831052:0:19485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869822.831054:0:19485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869822.831055:0:19485:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788869822.831058:0:19485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788869822.831089:0:19485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869822.831092:0:19485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869822.831093:0:19485:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788869822.831097:0:19485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788869822.831527:0:19481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788869822.831566:0:19481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788869822.831591:0:19481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff80030a00/0xbead52e175fc3ffa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc4001 expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869822.831603:0:19481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ff80030a00/0xbead52e175fc3ffa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc4001 expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869822.831612:0:19481:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ffbab91000 from 1 10000000:01000000:2.0:1788869822.831615:0:19481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788869822.831656:0:19481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99fe823c0200/0xbead52e175fc4016 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869822.831665:0:19481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99fe823c0200/0xbead52e175fc4016 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869822.831676:0:19481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99fe823c0200/0xbead52e175fc4016 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869822.831705:0:19481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554768000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788869822.831777:0:19481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869822.831812:0:19481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff87eecf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869822.832043:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554768000 00000100:00100000:3.0:1788869822.832050:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554768000 00000100:00100000:3.0:1788869822.832101:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788869822.832111:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffa00a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+22:19481:x1875765554768000:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869822.832125:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869822.832140:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb9a9ec00/0xbead52e175fc401d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc4016 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.832164:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb9a9ec00/0xbead52e175fc401d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc4016 expref: 23 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.832176:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb9a9ec00/0xbead52e175fc401d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc4016 expref: 23 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.832184:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9ec00, rc 0) 00000100:00100000:3.0:1788869822.832234:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffa00a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+23:19481:x1875765554768000:12345-0@lo:101:mount.lustre.0 Request processed in 125us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869822.832241:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788869822.832581:0:19481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554768000:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869822.832598:0:19481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99fe823c0200/0xbead52e175fc4016 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc401d expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.832607:0:19481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99fe823c0200/0xbead52e175fc4016 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc401d expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788869822.833747:0:19481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788869822.834165:0:19481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788869822.835642:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788869822.835691:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788869822.835712:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788869822.835718:0:19481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788869822.835814:0:19481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554768128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869822.835875:0:19481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869822.835919:0:19481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788869822.837246:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554768128 00000100:00100000:2.0:1788869822.837290:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554768128 00000100:00100000:2.0:1788869822.837348:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788869822.837358:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffa00a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+23:19481:x1875765554768128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869822.837533:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffa00a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+23:19481:x1875765554768128:12345-0@lo:501:mount.lustre.0 Request processed in 176us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869822.837541:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788869822.837767:0:19481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554768128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869822.837812:0:19481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554768256:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869822.837859:0:19481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869822.837894:0:19481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788869822.837927:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554768256 00000100:00100000:2.0:1788869822.837933:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554768256 00000100:00100000:2.0:1788869822.837966:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788869822.837973:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+23:19481:x1875765554768256:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869822.838064:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+23:19481:x1875765554768256:12345-0@lo:503:mount.lustre.0 Request processed in 91us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869822.838072:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788869822.840136:0:19481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554768256:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788869822.841138:0:19481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788869822.841229:0:19481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554768384:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869822.841334:0:19481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869822.841826:0:19481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869822.842019:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554768384 00000100:00100000:0.0:1788869822.842028:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554768384 00000100:00100000:1.0:1788869822.843300:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788869822.843314:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+23:19481:x1875765554768384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869822.844099:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+23:19481:x1875765554768384:12345-0@lo:502:mount.lustre.0 Request processed in 785us (2760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869822.844109:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788869822.846203:0:19481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554768384:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788869822.846486:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788869822.846525:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788869822.846540:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788869822.846553:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788869822.846565:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788869822.846591:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788869822.846605:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788869822.846619:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788869822.846632:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788869822.846645:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788869822.846658:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788869822.846696:0:19481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84026a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554768512:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869822.846761:0:19481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869822.847195:0:19481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8617cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869822.847268:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554768512 00000100:00100000:3.0:1788869822.847275:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554768512 00000100:00100000:3.0:1788869822.847315:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788869822.847322:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+23:19481:x1875765554768512:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869822.847455:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+23:19481:x1875765554768512:12345-0@lo:502:mount.lustre.0 Request processed in 132us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869822.847463:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788869822.847683:0:19481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84026a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554768512:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788869822.847729:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1788869822.847736:0:19481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788869822.848649:0:19489:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869822.848659:0:19489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869822.848661:0:19489:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788869822.848668:0:19489:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffbab91000 00000020:00000080:3.0:1788869822.848671:0:19489:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788869822.848682:0:19489:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869822.848684:0:19489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869822.848685:0:19489:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788869822.848688:0:19489:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869822.848690:0:19489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869822.848691:0:19489:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788869822.848695:0:19489:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ffbab91000 00000020:00000080:3.0:1788869822.848697:0:19489:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788869822.848762:0:19489:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869822.848766:0:19489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869822.848767:0:19489:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788869822.848770:0:19489:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869822.848772:0:19489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869822.848774:0:19489:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788869822.848777:0:19489:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ffbab91000 00000020:00000080:3.0:1788869822.848780:0:19489:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788869822.849485:0:19489:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869822.849490:0:19489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869822.849492:0:19489:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788869822.849494:0:19489:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869822.849510:0:19489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869822.849512:0:19489:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788869822.849515:0:19489:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99ffbab91000 00000020:00000080:3.0:1788869822.849517:0:19489:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788869822.849551:0:19489:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869822.849554:0:19489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869822.849555:0:19489:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788869822.849558:0:19489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1788869822.849733:0:19481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788869822.849759:0:19481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788869822.849775:0:19481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99fe823c0200/0xbead52e175fc4016 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc401d expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869822.849784:0:19481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99fe823c0200/0xbead52e175fc4016 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc401d expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869822.849937:0:19481:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788869822.849940:0:19481:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ffbab91000 10000000:01000000:0.0:1788869822.849942:0:19481:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ffbab91000 10000000:01000000:0.0:1788869822.849944:0:19481:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788869822.849949:0:19481:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99ffbab91000 from 1 10000000:01000000:0.0:1788869822.849950:0:19481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788869822.849988:0:19481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04800/0xbead52e175fc4024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869822.849995:0:19481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04800/0xbead52e175fc4024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869822.850005:0:19481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04800/0xbead52e175fc4024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869822.850025:0:19481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84026a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554768640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788869822.850084:0:19481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869822.850156:0:19481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8617cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788869822.855030:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554768640 00000100:00100000:3.0:1788869822.855054:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554768640 00000100:00100000:3.0:1788869822.855158:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788869822.855171:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+23:19481:x1875765554768640:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869822.855198:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869822.855229:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb9a9f000/0xbead52e175fc402b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc4024 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.855288:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb9a9f000/0xbead52e175fc402b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc4024 expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.855302:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb9a9f000/0xbead52e175fc402b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc4024 expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.855314:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9f000, rc 0) 00000100:00100000:3.0:1788869822.855986:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:19481:x1875765554768640:12345-0@lo:101:mount.lustre.0 Request processed in 815us (5899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869822.855994:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788869822.856020:0:19481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84026a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554768640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869822.856042:0:19481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04800/0xbead52e175fc4024 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc402b expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869822.856053:0:19481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04800/0xbead52e175fc4024 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc402b expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788869822.859140:0:19481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1788869822.860118:0:19481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869822.860340:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788869822.860971:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788869822.861007:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788869822.861038:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788869822.861053:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788869822.861067:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788869822.861081:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788869822.861094:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788869822.861106:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788869822.861129:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788869822.861145:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788869822.861158:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788869822.861171:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788869822.861184:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788869822.861196:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788869822.861207:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788869822.861220:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788869822.861233:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788869822.861246:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788869822.861294:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788869822.861312:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788869822.861326:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788869822.861339:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788869822.861351:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788869822.861364:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1788869822.862064:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1788869822.862082:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1788869822.862094:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1788869822.862108:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1788869822.862120:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1788869822.862134:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1788869822.862144:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1788869822.862151:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1788869822.862158:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1788869822.862165:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1788869822.862183:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1788869822.862191:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1788869822.862198:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1788869822.862205:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1788869822.862212:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1788869822.862219:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1788869822.862225:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1788869822.862239:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1788869822.862246:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1788869822.862282:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1788869822.862298:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1788869822.862323:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1788869822.862330:0:19481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1788869822.862524:0:19481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84026a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554768768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869822.862611:0:19481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869822.862663:0:19481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89972180 going to sleep for 11 seconds 00000100:00100000:3.0:1788869822.862679:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554768768 00000100:00100000:3.0:1788869822.862686:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554768768 00000100:00100000:3.0:1788869822.862742:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788869822.862753:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:19481:x1875765554768768:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869822.862885:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:19481:x1875765554768768:12345-0@lo:501:mount.lustre.0 Request processed in 134us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869822.862893:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788869822.863495:0:19481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84026a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554768768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869822.863533:0:19481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84026a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554768896:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869822.863587:0:19481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869822.863617:0:19481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89972180 going to sleep for 11 seconds 00000100:00100000:3.0:1788869822.864195:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554768896 00000100:00100000:3.0:1788869822.864202:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554768896 00000100:00100000:3.0:1788869822.864324:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788869822.864336:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:19481:x1875765554768896:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869822.864587:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:19481:x1875765554768896:12345-0@lo:503:mount.lustre.0 Request processed in 254us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869822.864595:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788869822.865052:0:19481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84026a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554768896:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788869822.867710:0:19481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788869822.867806:0:19481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84026a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554769024:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869822.868510:0:19481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869822.868558:0:19481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89972180 going to sleep for 11 seconds 00000100:00100000:3.0:1788869822.868589:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554769024 00000100:00100000:3.0:1788869822.868597:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554769024 00000100:00100000:3.0:1788869822.868655:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788869822.868665:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:19481:x1875765554769024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869822.868779:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:19481:x1875765554769024:12345-0@lo:502:mount.lustre.0 Request processed in 115us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869822.868787:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788869822.869007:0:19481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84026a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554769024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788869822.869208:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788869822.869239:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788869822.869291:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788869822.869309:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788869822.869322:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788869822.869337:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788869822.869351:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788869822.869364:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788869822.870029:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788869822.870045:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788869822.870059:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788869822.870073:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788869822.870087:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788869822.870101:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788869822.870114:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788869822.870127:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788869822.870141:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788869822.870155:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788869822.870183:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788869822.870200:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788869822.870213:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788869822.870227:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788869822.870241:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788869822.870277:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788869822.870296:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788869822.870310:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788869822.870324:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788869822.870336:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788869822.870348:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788869822.870362:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788869822.870994:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788869822.871012:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788869822.871026:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788869822.871039:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788869822.871064:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788869822.871078:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788869822.871092:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788869822.871105:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788869822.871118:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788869822.871129:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788869822.871141:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788869822.871162:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788869822.871174:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788869822.871186:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788869822.871199:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788869822.871210:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788869822.871222:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788869822.871235:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788869822.871310:0:19481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84026a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554769152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869822.872000:0:19481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869822.872054:0:19481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89972180 going to sleep for 11 seconds 00000100:00100000:3.0:1788869822.872590:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554769152 00000100:00100000:3.0:1788869822.872599:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554769152 00000100:00100000:3.0:1788869822.872652:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788869822.872661:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:19481:x1875765554769152:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869822.872798:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:19481:x1875765554769152:12345-0@lo:502:mount.lustre.0 Request processed in 138us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869822.872807:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788869822.872845:0:19481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84026a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554769152:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788869822.873180:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1788869822.873221:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1788869822.873272:0:19481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84026a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554769280:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869822.873315:0:19481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869822.873340:0:19481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89972180 going to sleep for 11 seconds 00000100:00100000:0.0:1788869822.873355:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554769280 00000100:00100000:0.0:1788869822.873358:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554769280 00000100:00100000:0.0:1788869822.874074:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788869822.874085:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:19481:x1875765554769280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869822.874182:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:19481:x1875765554769280:12345-0@lo:502:mount.lustre.0 Request processed in 100us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869822.874187:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788869822.874227:0:19481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84026a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554769280:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788869822.874292:0:19481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788869822.874302:0:19481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788869822.878517:0:19494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788869822.878535:0:19494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99ff9568cd40) 00000020:00000080:2.0:1788869822.878559:0:19494:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1788869822.879113:0:19494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffbab91000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788869822.879118:0:19494:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffbab91000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788869822.879120:0:19494:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffbab91000 3 00010000:00080000:2.0:1788869822.879150:0:19494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fe8109e800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.130@tcp at head 00010000:00010000:2.0:1788869822.883122:0:19494:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1788869822.883227:0:19494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788869822.883349:0:19494:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788869822.883362:0:19494:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbead52e175fc4039 00000100:00080000:2.0:1788869822.883441:0:19494:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869822.883448:0:19494:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99fe8109e800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788869822.883498:0:19494:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe8397d180 x1875765554769408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869822.883528:0:19494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788869822.883616:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3615:1875765554769408:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788869822.883693:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788869822.883797:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869822.883807:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869822.883809:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869822.883812:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869822.883844:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869822.883847:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788869822.883850:0:36:0:(import.c:65:import_set_state_nolock()) ffff99ff87c82800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869822.883855:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 436 00000100:00080000:0.0:1788869822.883860:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788869822.883864:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99ff87c82800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1788869822.883878:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe84026d80 x1875765554770048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788869822.883919:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554769664:0@lo:400:kworker.0 00000100:00100000:0.0:1788869822.883949:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869822.884001:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554769536:0@lo:400:kworker.0 00000100:00100000:1.0:1788869822.884034:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869822.884053:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875765554770176:0@lo:400:kworker.0 00000100:00100000:3.0:1788869822.884062:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554769920:0@lo:400:kworker.0 00000100:00100000:1.0:1788869822.884088:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554769792:0@lo:400:kworker.0 00000100:00100000:3.0:1788869822.884094:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869822.884109:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869822.884127:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554770432:0@lo:400:kworker.0 00000100:00100000:1.0:1788869822.884156:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554769536 00000100:00100000:1.0:1788869822.884162:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554769536 00000100:00100000:1.0:1788869822.884208:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554769792 00000100:00100000:1.0:1788869822.884212:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554769792 00000100:00100000:1.0:1788869822.884229:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788869822.884236:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554769536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869822.884303:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554769536:12345-0@lo:400:kworker.0 Request processed in 66us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869822.884312:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788869822.884327:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788869822.884332:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554769792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869822.884363:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554769792:12345-0@lo:400:kworker.0 Request processed in 31us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869822.884473:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788869822.884500:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554770048:0@lo:8:kworker.0 00000100:00100000:1.0:1788869822.884528:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869822.886734:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554769920 00000100:00100000:3.0:1788869822.886746:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554769920 00000100:00100000:3.0:1788869822.886798:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554770048 00000100:00100000:3.0:1788869822.886802:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554770048 00000100:00080000:1.0:1788869822.886818:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869822.886822:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869822.886831:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554769920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869822.886913:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554769920:12345-0@lo:400:kworker.0 Request processed in 83us (2817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869822.886921:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869822.886937:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788869822.886941:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1875765554770048:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788869822.886997:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1875765554770048:12345-0@lo:8:kworker.0 Request processed in 54us (2468us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788869822.887004:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869822.887029:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788869822.887037:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ff87c82800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00010000:00080000:3.0:1788869822.887041:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe84026680 x1875765554769920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788869822.887041:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788869822.887045:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554770048:0@lo:8:kworker.0 00000100:00100000:3.0:1788869822.887052:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554769920:0@lo:400:kworker.0 00000100:00100000:1.0:1788869822.887223:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554769664 00000100:00100000:0.0:1788869822.887232:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875765554770304:0@lo:400:kworker.0 00000100:00100000:1.0:1788869822.887237:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554769664 00000100:00100000:1.0:1788869822.887287:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788869822.887294:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554769664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869822.887339:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554769408 00000100:00100000:2.0:1788869822.887350:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554769408 00000100:00100000:2.0:1788869822.887380:0:17162:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788869822.887387:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788869822.887677:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869822.887682:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1875765554769408:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788869822.887699:0:17162:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:2.0:1788869822.887732:0:17162:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbead52e175fc4040 00000004:00100000:2.0:1788869822.887748:0:17162:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788869822.887783:0:17162:0:(import.c:65:import_set_state_nolock()) ffff99fe81099800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869822.888057:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554769664:12345-0@lo:400:kworker.0 Request processed in 763us (4106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869822.888064:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788869822.888090:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869822.888133:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554769792:0@lo:400:kworker.0 00000100:00100000:1.0:1788869822.888152:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869822.888175:0:19497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554770432 00000100:00100000:3.0:1788869822.888179:0:19497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554770432 00000100:00100000:1.0:1788869822.888182:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554769536:0@lo:400:kworker.0 00000100:00080000:3.0:1788869822.888195:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869822.888196:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554770176 00000100:00100000:1.0:1788869822.888198:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554770176 00000100:00100000:1.0:1788869822.888215:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788869822.888226:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875765554770176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869822.888280:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875765554770176:12345-0@lo:400:kworker.0 Request processed in 59us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869822.888346:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875765554769408:12345-0@lo:38:llog_process_th.0 Request processed in 662us (4652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869822.892645:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869822.892857:0:19497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788869822.892969:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788869822.892988:0:19497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554770432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869822.893009:0:17160:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788869822.893017:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788869822.893042:0:17161:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788869822.893053:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554770304 00000100:00100000:1.0:1788869822.893061:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554770304 00000100:00100000:1.0:1788869822.893092:0:17161:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788869822.893099:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788869822.893105:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875765554770304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869822.893141:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875765554770304:12345-0@lo:400:kworker.0 Request processed in 36us (503us total) trans 0 rc 0/0 00000100:00080000:3.0:1788869822.893148:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869822.893148:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788869822.893180:0:19497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554770432:12345-0@lo:400:kworker.0 Request processed in 313us (5089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869822.893187:0:19497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788869822.893203:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe839bd880 x1875765554770432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869822.893218:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554770432:0@lo:400:kworker.0 00010000:00080000:1.0:1788869822.893269:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe839bea00 x1875765554770176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869822.893279:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875765554770176:0@lo:400:kworker.0 00000100:00100000:2.0:1788869822.893349:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788869822.893465:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe8397d180 x1875765554769408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869822.893474:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788869822.893482:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788869822.893489:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788869822.893494:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00010000:00080000:0.0:1788869822.893496:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe839bdf80 x1875765554770304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788869822.893498:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99fe8109e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788869822.893503:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3615:1875765554769408:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788869822.893504:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875765554770304:0@lo:400:kworker.0 00010000:00080000:0.0:1788869822.893524:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe84024700 x1875765554769664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869822.893531:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554769664:0@lo:400:kworker.0 00000020:01000004:2.0:1788869822.894241:0:19494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788869822.894337:0:19494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff99ff95688000) 00000020:00000080:2.0:1788869822.894362:0:19494:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1788869822.894590:0:19494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ffbab91000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788869822.894595:0:19494:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ffbab91000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788869822.894598:0:19494:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ffbab91000 3 00010000:00080000:2.0:1788869822.894626:0:19494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99fe81098800@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.130@tcp at head 00010000:00010000:2.0:1788869822.897511:0:19494:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1788869822.898000:0:19494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788869822.898049:0:19494:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788869822.898062:0:19494:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xbead52e175fc404e 00000100:00080000:2.0:1788869822.898073:0:19494:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869822.898078:0:19494:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff99fe81098800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788869822.898113:0:19494:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe8397d180 x1875765554770560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869822.899629:0:19494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788869822.900760:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869822.900775:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869822.900778:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869822.900781:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788869822.903017:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3615:1875765554770560:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788869822.903116:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788869822.903745:0:19494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788869822.906201:0:19481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788869822.906671:0:19481:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788869822.906690:0:19481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04800/0xbead52e175fc4024 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc402b expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.906703:0:19481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04800/0xbead52e175fc4024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc402b expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788869822.906760:0:19481:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788869822.906762:0:19481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788869822.906764:0:19481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869822.906765:0:19481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869822.906766:0:19481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869822.906767:0:19481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869822.906768:0:19481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869822.906770:0:19481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869822.906771:0:19481:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788869822.906775:0:19481:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788869822.906778:0:19481:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788869822.906779:0:19481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788869822.906780:0:19481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869822.906781:0:19481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869822.906782:0:19481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869822.906783:0:19481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869822.906784:0:19481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869822.906785:0:19481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869822.906792:0:19481:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788869822.906819:0:19481:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788869822.906841:0:19481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554770688:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788869822.906911:0:19481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869822.906947:0:19481:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff84fad240 going to sleep for 11 seconds 00000100:00100000:3.0:1788869822.908406:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554770688 00000100:00100000:3.0:1788869822.908419:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554770688 00000100:00100000:3.0:1788869822.908487:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788869822.908497:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:19481:x1875765554770688:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788869822.908532:0:17153:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788869822.908547:0:17153:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788869822.910468:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554770560 00000100:00100000:2.0:1788869822.910480:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554770560 00000100:00100000:2.0:1788869822.910528:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869822.910535:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3615:x1875765554770560:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788869822.910565:0:17161:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:2.0:1788869822.910614:0:17161:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xbead52e175fc4055 00000004:00100000:2.0:1788869822.910633:0:17161:0:(mdt_handler.c:7366:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788869822.910672:0:17161:0:(import.c:65:import_set_state_nolock()) ffff99ff8554a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869822.910767:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875765554770560:12345-0@lo:38:llog_process_th.0 Request processed in 231us (7651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869822.910775:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788869822.911023:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99fe8397d180 x1875765554770560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869822.911037:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788869822.911045:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788869822.911052:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788869822.911057:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788869822.911059:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99fe81098800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788869822.911064:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3615:1875765554770560:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1788869822.914785:0:17153:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788869822.914809:0:17153:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788869822.915025:0:17176:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788869822.915030:0:17176:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788869822.915051:0:17176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc405c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.915069:0:17176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffbfb04e00/0xbead52e175fc3fd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3fc9 expref: 24 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.915077:0:17176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffbfb05e00/0xbead52e175fc3fde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3fd7 expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.915085:0:17176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc405c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.915127:0:17176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffbfb05e00/0xbead52e175fc3fde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc3fd7 expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.915138:0:17176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffbfb05e00/0xbead52e175fc3fde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc3fd7 expref: 24 pid: 17154 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869822.915149:0:17176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb11500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17176:1875765554770816:0@lo:104: 00000100:00100000:3.0:1788869822.915199:0:17176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869822.915271:0:17176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffbfb04e00/0xbead52e175fc3fd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc3fc9 expref: 24 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.915281:0:17176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffbfb04e00/0xbead52e175fc3fd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc3fc9 expref: 24 pid: 17153 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869822.915289:0:17176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb13b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17176:1875765554770944:0@lo:104: 00000100:00100000:3.0:1788869822.915312:0:17176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869822.915329:0:17176:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8523ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869822.915344:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554770944 00000100:00100000:1.0:1788869822.915351:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554770944 00000100:00100000:2.0:1788869822.915511:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:19481:x1875765554770688:12345-0@lo:253:mount.lustre.0 Request processed in 7015us (8600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869822.915522:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788869822.915619:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788869822.915627:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+3:17176:x1875765554770944:12345-0@lo:104: 00010000:00010000:1.0:1788869822.915640:0:17143:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99fe823c1600/0xbead52e175fc3fc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3fd0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.915703:0:17143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788869822.915709:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+3:17176:x1875765554770944:12345-0@lo:104: Request processed in 83us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869822.915716:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1788869822.915733:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869822.915738:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99fe823c1600/0xbead52e175fc3fc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3fd0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.915746:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1600 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1788869822.915750:0:17148:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99fe823c1600/0xbead52e175fc3fc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc3fd0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.915758:0:17148:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99fe823c1600/0xbead52e175fc3fc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc3fd0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869822.915765:0:17148:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99fe823c1600/0xbead52e175fc3fc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc3fd0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869822.915782:0:17148:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788869822.915811:0:17148:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99fe823c1600/0xbead52e175fc3fc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3fd0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.915818:0:17148:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869822.915838:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99fe823c1600/0xbead52e175fc3fc9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3fd0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.915845:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99fe823c1600/0xbead52e175fc3fc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3fd0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.915862:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869822.915864:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869822.915865:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869822.915884:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3618:1875765554771072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869822.915910:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869822.915953:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554771072 00000100:00100000:1.0:1788869822.915957:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554771072 00010000:00010000:1.0:1788869822.915976:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffbfb04e00/0xbead52e175fc3fd0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3fc9 expref: 24 pid: 17153 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869822.915995:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788869822.916000:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:3618:x1875765554771072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869822.916009:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869822.916013:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffbfb04e00/0xbead52e175fc3fd0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3fc9 expref: 24 pid: 17153 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.916021:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffbfb04e00/0xbead52e175fc3fd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc3fc9 expref: 24 pid: 17153 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.916042:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869822.916070:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:3618:x1875765554771072:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869822.916077:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788869822.916110:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3618:1875765554771072:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869822.916177:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffbfb04e00/0xbead52e175fc3fd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc3fc9 expref: 23 pid: 17153 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869822.916196:0:17176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb13b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17176:1875765554770944:0@lo:104: 00000100:00100000:0.0:1788869822.916654:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554770816 00000100:00100000:0.0:1788869822.916660:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554770816 00000100:00100000:3.0:1788869822.916703:0:19481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:19481:1875765554770688:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788869822.916716:0:19481:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788869822.916720:0:19481:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788869822.916721:0:19481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788869822.916722:0:19481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869822.916723:0:19481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869822.916725:0:19481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869822.916726:0:19481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869822.916727:0:19481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869822.916729:0:19481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869822.916730:0:19481:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788869822.916741:0:19481:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788869822.916824:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788869822.916831:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+3:17176:x1875765554770816:12345-0@lo:104: 00010000:00010000:1.0:1788869822.916841:0:17144:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04a00/0xbead52e175fc3fd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3fde expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.916888:0:17144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788869822.916893:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+3:17176:x1875765554770816:12345-0@lo:104: Request processed in 63us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869822.916898:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788869822.916914:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869822.916919:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04a00/0xbead52e175fc3fd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3fde expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.916927:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04a00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1788869822.916930:0:17149:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04a00/0xbead52e175fc3fd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc3fde expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.916938:0:17149:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04a00/0xbead52e175fc3fd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc3fde expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869822.916944:0:17149:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04a00/0xbead52e175fc3fd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc3fde expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869822.916962:0:17149:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788869822.916985:0:17149:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04a00/0xbead52e175fc3fd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3fde expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.916991:0:17149:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869822.917004:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04a00/0xbead52e175fc3fd7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3fde expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.917010:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04a00/0xbead52e175fc3fd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3fde expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.917026:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869822.917028:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869822.917030:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869822.917040:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3619:1875765554771200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869822.917069:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869822.917108:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554771200 00000100:00100000:1.0:1788869822.917112:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554771200 00010000:00010000:1.0:1788869822.917126:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffbfb05e00/0xbead52e175fc3fde lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3fd7 expref: 23 pid: 17154 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869822.917146:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788869822.917153:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+23:3619:x1875765554771200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869822.917161:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869822.917165:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffbfb05e00/0xbead52e175fc3fde lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3fd7 expref: 23 pid: 17154 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.917175:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffbfb05e00/0xbead52e175fc3fde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc3fd7 expref: 23 pid: 17154 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.917197:0:17145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc405c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.917206:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc405c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788869822.917220:0:17145:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007236943s 00010000:00010000:1.0:1788869822.917224:0:17145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc405c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.917232:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc405c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.917239:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc405c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.917246:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc405c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.917350:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9e200 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:1.0:1788869822.917354:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc405c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.917593:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc405c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.917603:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc405c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869822.917616:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869822.917650:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+23:3619:x1875765554771200:12345-0@lo:103:ldlm_bl.0 Request processed in 496us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869822.917663:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788869822.917698:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3619:1875765554771200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869822.917906:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffbfb05e00/0xbead52e175fc3fde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc3fd7 expref: 22 pid: 17154 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869822.917918:0:17176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb11500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17176:1875765554770816:0@lo:104: 00010000:00010000:2.0:1788869822.917937:0:17176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc405c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869822.917946:0:17176:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc405c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869822.917952:0:17176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc405c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869822.917959:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb9a9e200/0xbead52e175fc405c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1788869822.932155:0:19481:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788869822.935619:0:19481:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788869822.935630:0:19481:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788869822.935667:0:19481:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788869822.935709:0:19481:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788869822.935727:0:19481:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788869822.935750:0:19481:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788869822.936606:0:19481:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788869822.936836:0:19481:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788869823.320345:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869823.386974:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869823.387002:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554771328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869823.387079:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869823.387210:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554771328 00000100:00100000:1.0:1788869823.387218:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554771328 00000100:00100000:1.0:1788869823.387303:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869823.387314:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554771328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869823.387342:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788869823.387390:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554771328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869823.387397:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788869823.387433:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfb1c000 x1875765554771328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869823.387453:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554771328:0@lo:13:osp-pre-0-1.0 00000020:00000004:2.0:1788869823.600889:0:19549:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788869823.601218:0:19549:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788869824.089344:0:17157:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788869824.089356:0:17157:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99ffbf9b2000 from 10 10000000:01000000:1.0:1788869824.089363:0:17157:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788869824.089430:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff80031a00/0xbead52e175fc4063 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869824.089444:0:17157:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ff80031a00/0xbead52e175fc4063 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869824.089457:0:17157:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ff80031a00/0xbead52e175fc4063 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869824.089490:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554771456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869824.089612:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869824.089691:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae5fe180 going to sleep for 11 seconds 00000100:00100000:3.0:1788869824.090413:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554771456 00000100:00100000:3.0:1788869824.090429:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554771456 00000100:00100000:3.0:1788869824.090481:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788869824.090491:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+22:17157:x1875765554771456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869824.090508:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869824.090529:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb9a9ee00/0xbead52e175fc406a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc4063 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869824.090581:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb9a9ee00/0xbead52e175fc406a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc4063 expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869824.090592:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb9a9ee00/0xbead52e175fc406a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc4063 expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869824.090602:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb9a9ee00, rc 0) 00000100:00100000:3.0:1788869824.090670:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+23:17157:x1875765554771456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869824.090677:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788869824.092107:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554771456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869824.092151:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ff80031a00/0xbead52e175fc4063 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc406a expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869824.092168:0:17157:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ff80031a00/0xbead52e175fc4063 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc406a expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869824.092316:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554771584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788869824.092403:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869824.092461:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae5fe180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869824.093287:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554771584 00000100:00100000:2.0:1788869824.093303:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554771584 00000100:00100000:2.0:1788869824.093386:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788869824.093397:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+23:17157:x1875765554771584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788869824.093423:0:17153:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788869824.093440:0:17153:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788869824.093444:0:17153:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788869824.093597:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+23:17157:x1875765554771584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 199us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869824.093607:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788869824.093678:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554771584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788869824.093749:0:17157:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788869824.093759:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff80031a00/0xbead52e175fc4063 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc406a expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869824.093771:0:17157:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ff80031a00/0xbead52e175fc4063 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc406a expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869824.093782:0:17157:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788869824.093785:0:17157:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99fe81f16800 from 10 10000000:01000000:2.0:1788869824.093788:0:17157:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788869824.093817:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99fe823c0e00/0xbead52e175fc4071 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869824.093827:0:17157:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99fe823c0e00/0xbead52e175fc4071 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869824.093836:0:17157:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99fe823c0e00/0xbead52e175fc4071 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869824.093857:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554771712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869824.093898:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869824.093919:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe81e24780 going to sleep for 11 seconds 00000100:00100000:1.0:1788869824.093967:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554771712 00000100:00100000:1.0:1788869824.093976:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554771712 00000100:00100000:1.0:1788869824.094033:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788869824.094043:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+23:17157:x1875765554771712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869824.094066:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869824.094088:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb95a9400/0xbead52e175fc4078 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc4071 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869824.094118:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb95a9400/0xbead52e175fc4078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc4071 expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869824.094130:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb95a9400/0xbead52e175fc4078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc4071 expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869824.094140:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a9400, rc 0) 00000100:00100000:1.0:1788869824.094212:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:17157:x1875765554771712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869824.094231:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788869824.094290:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554771712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869824.094313:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99fe823c0e00/0xbead52e175fc4071 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc4078 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869824.094324:0:17157:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99fe823c0e00/0xbead52e175fc4071 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc4078 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869824.094385:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554771840:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788869824.094427:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869824.094452:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff9553d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788869824.094629:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554771840 00000100:00100000:1.0:1788869824.094636:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554771840 00000100:00100000:2.0:1788869824.094741:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788869824.094754:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc21e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:17157:x1875765554771840:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788869824.094771:0:17153:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788869824.094787:0:17153:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788869824.094790:0:17153:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788869824.094861:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc21e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:17157:x1875765554771840:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869824.094870:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788869824.094974:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554771840:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788869824.095066:0:17157:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788869824.095076:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99fe823c0e00/0xbead52e175fc4071 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc4078 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869824.095085:0:17157:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99fe823c0e00/0xbead52e175fc4071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc4078 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869824.346125:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869824.408469:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554771968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869824.408553:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869824.408616:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554771968 00000100:00100000:1.0:1788869824.408624:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554771968 00000100:00100000:1.0:1788869824.408672:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788869824.408680:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554771968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788869824.408712:0:17166:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788869824.408755:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554771968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869824.408761:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788869824.408803:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554771968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869824.410144:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe839bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554772096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869824.410194:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869824.410762:0:17901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554772096 00000100:00100000:2.0:1788869824.410771:0:17901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554772096 00000100:00100000:2.0:1788869824.410843:0:17901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788869824.410851:0:17901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554772096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869824.410879:0:17901:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788869824.410934:0:17901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554772096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869824.410940:0:17901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788869824.411001:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554772096:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788869825.370626:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788869825.629129:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788869826.008336:0:3615:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869805/real 1788869805] req@ffff99fe839bc000 x1875765554758784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869825 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869826.008373:0:3615:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99fe839bc000 x1875765554758784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869825 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869826.008384:0:3615:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869805/real 1788869805] req@ffff99fe839bed80 x1875765554758912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869825 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869826.008396:0:3615:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99fe839bed80 x1875765554758912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869825 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788869826.008417:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffae5cb800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869826.008446:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788869826.008450:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554758784:0@lo:8:kworker.0 00000100:00080000:0.0:1788869826.008456:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffb89f1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869826.008463:0:3615:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788869826.008466:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe839bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554758912:0@lo:8:kworker.0 00000100:00080000:2.0:1788869826.008855:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869826.008860:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788869826.008863:0:36:0:(import.c:65:import_set_state_nolock()) ffff99ffae5cb800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869826.008869:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 423 00000100:00080000:2.0:1788869826.008876:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788869826.008884:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ffae5cb800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788869826.008907:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe8397dc00 x1875765554772480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869826.008934:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869826.008937:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788869826.008938:0:36:0:(import.c:65:import_set_state_nolock()) ffff99ffb89f1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869826.008941:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 423 00000100:00080000:2.0:1788869826.008944:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788869826.008947:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ffb89f1000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788869826.008962:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe8397ed80 x1875765554772608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869826.008989:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869826.008992:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788869826.008993:0:36:0:(import.c:65:import_set_state_nolock()) ffff99ff87c82800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869826.008998:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99ff87c82800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1788869826.009008:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99fe8397c000 x1875765554773120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788869826.009061:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554772352:0@lo:400:kworker.0 00000100:00100000:2.0:1788869826.009127:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869826.009157:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554773248:0@lo:400:kworker.0 00000100:00100000:2.0:1788869826.009182:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869826.009199:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554773760:0@lo:400:kworker.0 00000100:00100000:2.0:1788869826.009220:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869826.009240:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788869826.009245:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554772736:0@lo:400:kworker.0 00000100:00100000:2.0:1788869826.009294:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869826.009318:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875765554773376:0@lo:400:kworker.0 00000100:00100000:2.0:1788869826.009339:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869826.009371:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554772352 00000100:00100000:2.0:1788869826.009377:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554772352 00000100:00100000:2.0:1788869826.009422:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788869826.009430:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554772352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869826.009477:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554772352:12345-0@lo:400:kworker.0 Request processed in 48us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869826.009485:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788869826.009601:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554773248 00000100:00100000:2.0:1788869826.009606:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554773248 00000100:00100000:2.0:1788869826.009629:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554773760 00000100:00100000:2.0:1788869826.009632:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554773760 00000100:00100000:2.0:1788869826.009651:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554772736 00000100:00100000:2.0:1788869826.009653:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554772736 00000100:00100000:2.0:1788869826.009661:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554773376 00000100:00100000:2.0:1788869826.009663:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554773376 00000100:00100000:2.0:1788869826.009676:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788869826.009682:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554773248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869826.009715:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554773248:12345-0@lo:400:kworker.0 Request processed in 33us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869826.009722:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788869826.009733:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788869826.009738:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554773760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869826.009761:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554773760:12345-0@lo:400:kworker.0 Request processed in 24us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869826.009767:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788869826.009778:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788869826.009791:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554772736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869826.009819:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875765554772736:12345-0@lo:400:kworker.0 Request processed in 30us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869826.009842:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788869826.009853:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788869826.009859:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875765554773376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869826.009885:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875765554773376:12345-0@lo:400:kworker.0 Request processed in 26us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869826.009891:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788869826.009933:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8397c700 x1875765554772736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869826.009945:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875765554772736:0@lo:400:kworker.0 00010000:00080000:2.0:1788869826.009955:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8397ca80 x1875765554773376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869826.009963:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875765554773376:0@lo:400:kworker.0 00000100:00100000:2.0:1788869826.009974:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554772352:0@lo:400:kworker.0 00010000:00080000:2.0:1788869826.009982:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8397e300 x1875765554773248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869826.009990:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554773248:0@lo:400:kworker.0 00010000:00080000:2.0:1788869826.009999:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8397c380 x1875765554773760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869826.010007:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554773760:0@lo:400:kworker.0 00000100:00100000:0.0:1788869826.010131:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554772864:0@lo:400:kworker.0 00000100:00100000:0.0:1788869826.010166:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869826.010184:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554773504:0@lo:400:kworker.0 00000100:00100000:0.0:1788869826.010202:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869826.010220:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788869826.010226:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3618:1875765554772224:0@lo:400:kworker.0 00000100:00100000:0.0:1788869826.010267:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869826.010295:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554772992:0@lo:400:kworker.0 00000100:00100000:0.0:1788869826.010322:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869826.010339:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554773632:0@lo:400:kworker.0 00000100:00100000:0.0:1788869826.010361:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869826.010386:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554772224 00000100:00100000:0.0:1788869826.010390:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554772224 00000100:00100000:0.0:1788869826.010420:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788869826.010426:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffc21e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:3618:x1875765554772224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869826.010461:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffc21e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:3618:x1875765554772224:12345-0@lo:400:kworker.0 Request processed in 35us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869826.010467:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788869826.010507:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554772992 00000100:00100000:0.0:1788869826.010519:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554772992 00000100:00100000:0.0:1788869826.010548:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869826.010554:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554772992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869826.010583:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554772992:12345-0@lo:400:kworker.0 Request processed in 29us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869826.010588:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869826.010610:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554773504 00000100:00100000:0.0:1788869826.010614:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554773504 00000100:00100000:0.0:1788869826.010642:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554773632 00000100:00100000:0.0:1788869826.010645:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554773632 00000100:00100000:0.0:1788869826.010659:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869826.010664:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554773504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869826.010694:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875765554773504:12345-0@lo:400:kworker.0 Request processed in 29us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869826.010700:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869826.010710:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788869826.010716:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554773632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869826.010740:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554773632:12345-0@lo:400:kworker.0 Request processed in 25us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869826.010745:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788869826.010779:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554772480:0@lo:8:kworker.0 00000100:00100000:0.0:1788869826.010804:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869826.010823:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554772608:0@lo:8:kworker.0 00000100:00100000:0.0:1788869826.010843:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869826.010861:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554773120:0@lo:8:kworker.0 00000100:00100000:0.0:1788869826.010882:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869826.010904:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554772480 00000100:00100000:0.0:1788869826.010909:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554772480 00000100:00100000:0.0:1788869826.010924:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554772608 00000100:00100000:0.0:1788869826.010926:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554772608 00000100:00100000:0.0:1788869826.010932:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554773120 00000100:00100000:0.0:1788869826.010934:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554773120 00000100:00100000:0.0:1788869826.010943:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788869826.010948:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1875765554772480:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788869826.010972:0:18667:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:0.0:1788869826.011007:0:18667:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbead52e175fc407f 00002000:00100000:0.0:1788869826.011021:0:18667:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99fe81f59800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788869826.011024:0:18667:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788869826.011026:0:18667:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788869826.011102:0:18667:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788869826.011124:0:18667:0:(import.c:65:import_set_state_nolock()) ffff99fe81f5b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869826.011161:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1875765554772480:12345-0@lo:8:kworker.0 Request processed in 212us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869826.011167:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788869826.011178:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788869826.011182:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1875765554772608:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788869826.011197:0:18667:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:0.0:1788869826.011210:0:18667:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbead52e175fc4086 00002000:00100000:0.0:1788869826.011216:0:18667:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99fe81f5d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788869826.011220:0:18667:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788869826.011222:0:18667:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788869826.011383:0:18667:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788869826.011396:0:18667:0:(import.c:65:import_set_state_nolock()) ffff99fe81f5e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869826.011425:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1875765554772608:12345-0@lo:8:kworker.0 Request processed in 240us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869826.011431:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788869826.011443:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788869826.011447:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1875765554773120:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788869826.011461:0:18667:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:0.0:1788869826.011476:0:18667:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbead52e175fc408d 00002000:00100000:0.0:1788869826.011482:0:18667:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff99fe81f5c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113718 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788869826.011493:0:18667:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1788869826.011494:0:18667:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788869826.011526:0:18667:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788869826.011538:0:18667:0:(import.c:65:import_set_state_nolock()) ffff99fe81f5d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869826.011566:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3615:x1875765554773120:12345-0@lo:8:kworker.0 Request processed in 118us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869826.011573:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788869826.011612:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3618:1875765554772224:0@lo:400:kworker.0 00010000:00080000:0.0:1788869826.011625:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8397ce00 x1875765554772992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869826.011634:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554772992:0@lo:400:kworker.0 00010000:00080000:0.0:1788869826.011643:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8397d180 x1875765554773632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869826.011651:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554773632:0@lo:400:kworker.0 00010000:00080000:0.0:1788869826.011659:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8397d880 x1875765554773504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869826.011666:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875765554773504:0@lo:400:kworker.0 00010000:00080000:0.0:1788869826.011700:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8397dc00 x1875765554772480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869826.011707:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788869826.011713:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788869826.011720:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788869826.011726:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788869826.011727:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffae5cb800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788869826.011749:0:3615:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:0.0:1788869826.011753:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554772480:0@lo:8:kworker.0 00010000:00080000:0.0:1788869826.011766:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8397ed80 x1875765554772608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869826.011773:0:3615:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788869826.011776:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788869826.011781:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788869826.011783:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788869826.011785:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ffb89f1000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788869826.011793:0:3615:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:0.0:1788869826.011795:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875765554772608:0@lo:8:kworker.0 00010000:00080000:0.0:1788869826.011805:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8397c000 x1875765554773120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788869826.011812:0:3615:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788869826.011816:0:3615:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788869826.011818:0:3615:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788869826.011820:0:3615:0:(import.c:65:import_set_state_nolock()) ffff99ff87c82800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788869826.011840:0:3615:0:(osp_dev.c:1705:osp_import_event()) got connected 00000100:00100000:0.0:1788869826.011844:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875765554773120:0@lo:8:kworker.0 00000004:00080000:0.0:1788869826.011867:0:17184:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788869826.011924:0:17184:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 443938671149ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788869826.011931:0:17184:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788869826.011954:0:17904:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788869826.011992:0:17904:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 443938739174ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788869826.011997:0:17904:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788869826.012798:0:17901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554772864 00000100:00100000:2.0:1788869826.012811:0:17901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554772864 00000100:00100000:2.0:1788869826.012849:0:17901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788869826.012856:0:17901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe839bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554772864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869826.012912:0:17901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe839bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554772864:12345-0@lo:400:kworker.0 Request processed in 56us (2745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869826.012918:0:17901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000004:00080000:2.0:1788869826.012966:0:17187:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1788869826.012986:0:17187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8401ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17187:1875765554774016:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788869826.013022:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869826.013041:0:17187:0:(client.c:2702:ptlrpc_set_wait()) set ffff99fe82c43480 going to sleep for 11 seconds 00000004:00080000:2.0:1788869826.013055:0:17186:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788869826.013109:0:17186:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 443939855145ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788869826.013118:0:17186:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788869826.013149:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554773888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869826.013174:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869826.013208:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554773888 00000100:00100000:2.0:1788869826.013212:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554773888 00000100:00100000:2.0:1788869826.013242:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869826.013247:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875765554773888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869826.013286:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788869826.013319:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875765554773888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869826.013324:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788869826.013351:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe84018e00 x1875765554773888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869826.013366:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554773888:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788869826.013731:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869826.013736:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869826.013740:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869826.013743:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1788869826.013770:0:17185:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:3.0:1788869826.013786:0:17185:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb11880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17185:1875765554774272:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788869826.013821:0:17185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869826.013837:0:17185:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89c61240 going to sleep for 11 seconds 00000004:00080000:3.0:1788869826.014366:0:17905:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788869826.014384:0:17905:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb13b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17905:1875765554774528:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788869826.014411:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869826.014428:0:17905:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89c613c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869826.014574:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554774400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869826.014604:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869826.014668:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869826.014675:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554774144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869826.014699:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869826.014839:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554774016 00000100:00100000:0.0:1788869826.014847:0:19213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554774016 00000100:00100000:0.0:1788869826.014893:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554774272 00000100:00100000:0.0:1788869826.014896:0:19213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554774272 00000100:00100000:0.0:1788869826.014917:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554774528 00000100:00100000:0.0:1788869826.014920:0:19213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554774528 00000100:00100000:0.0:1788869826.014938:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788869826.014947:0:19213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17187:x1875765554774016:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788869826.015191:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788869826.015199:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17185:x1875765554774272:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1788869826.015355:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869826.015359:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869826.019482:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554772864:0@lo:400:kworker.0 00000004:00080000:0.0:1788869826.020753:0:17893:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788869826.020782:0:18669:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788869826.020790:0:18669:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788869826.020796:0:18669:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000100:00100000:3.0:1788869826.027261:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554774400 00000100:00100000:3.0:1788869826.027278:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554774400 00000100:00100000:3.0:1788869826.027335:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554774144 00000100:00100000:3.0:1788869826.027339:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554774144 00000100:00100000:3.0:1788869826.027360:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869826.027380:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3619:x1875765554774400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869826.027406:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788869826.028410:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3619:x1875765554774400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1027us (13799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869826.028419:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869826.028443:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788869826.028454:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1875765554774144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869826.028478:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788869826.028641:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1875765554774144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 190us (13940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869826.028647:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788869826.028708:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfb11c00 x1875765554774144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869826.028731:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554774144:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788869826.028746:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfb11500 x1875765554774400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869826.028758:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554774400:0@lo:13:osp-pre-1-1.0 00002000:00010000:2.0:1788869826.041671:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869826.041684:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039cc6764/0xbead52e175fc4094 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.041701:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788869826.041707:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869826.041713:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039cc6764/0xbead52e175fc4094 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.041731:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039cc6764/0xbead52e175fc4094 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.041742:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039cc6764/0xbead52e175fc4094 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.041750:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039cc6764/0xbead52e175fc4094 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.041771:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869826.041782:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869826.041789:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039cc6764/0xbead52e175fc4094 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.041807:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1800 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869826.041812:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039cc6764/0xbead52e175fc4094 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.041821:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039cc6764/0xbead52e175fc4094 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.041839:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039cc6764/0xbead52e175fc4094 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.041847:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039cc6764/0xbead52e175fc4094 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.041863:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.041865:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.041867:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788869826.042453:0:17140:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:2.0:1788869826.043205:0:19213:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788869826.043214:0:19213:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788869826.043220:0:19213:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00010000:0.0:1788869826.047306:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869826.047320:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012216c14/0xbead52e175fc409b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.047336:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1788869826.047341:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869826.047347:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012216c14/0xbead52e175fc409b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.047360:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012216c14/0xbead52e175fc409b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.047380:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012216c14/0xbead52e175fc409b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.047387:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012216c14/0xbead52e175fc409b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.047408:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869826.047419:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869826.047424:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012216c14/0xbead52e175fc409b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.047432:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05200 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.047436:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012216c14/0xbead52e175fc409b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.047445:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012216c14/0xbead52e175fc409b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.047462:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012216c14/0xbead52e175fc409b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.047470:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012216c14/0xbead52e175fc409b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.047574:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.047582:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.047584:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869826.052910:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869826.052924:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc40a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.052942:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1788869826.052946:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869826.052953:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc40a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.052967:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc40a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.052977:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc40a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.052985:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc40a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.053007:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869826.053327:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869826.053335:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc40a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.053345:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04400 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869826.053350:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc40a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.053371:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc40a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.053391:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc40a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.053398:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b20f0e26/0xbead52e175fc40a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.053418:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.053420:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.053422:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869826.054450:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869826.054461:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edb0f169/0xbead52e175fc40a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.054475:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1788869826.054479:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869826.054484:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edb0f169/0xbead52e175fc40a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.054524:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edb0f169/0xbead52e175fc40a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.054534:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edb0f169/0xbead52e175fc40a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.054542:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edb0f169/0xbead52e175fc40a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.054559:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869826.054568:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869826.054573:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edb0f169/0xbead52e175fc40a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.054580:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05400 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.054584:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edb0f169/0xbead52e175fc40a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.054592:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edb0f169/0xbead52e175fc40a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.054603:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edb0f169/0xbead52e175fc40a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.054611:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edb0f169/0xbead52e175fc40a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.054632:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.054633:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.054635:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788869826.054883:0:17140:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788869826.055320:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.055328:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000690c56ed/0xbead52e175fc40b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.055339:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1788869826.055342:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.055347:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000690c56ed/0xbead52e175fc40b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.055358:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000690c56ed/0xbead52e175fc40b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.055367:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000690c56ed/0xbead52e175fc40b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.055382:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000690c56ed/0xbead52e175fc40b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.055398:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869826.055607:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869826.055613:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000690c56ed/0xbead52e175fc40b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.055622:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fc00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.055626:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000690c56ed/0xbead52e175fc40b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.055634:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000690c56ed/0xbead52e175fc40b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.055647:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000690c56ed/0xbead52e175fc40b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.055654:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000690c56ed/0xbead52e175fc40b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.055674:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.055675:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.055677:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869826.056195:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.056203:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa312b1a/0xbead52e175fc40b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.056212:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1788869826.056215:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.056220:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa312b1a/0xbead52e175fc40b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.056229:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa312b1a/0xbead52e175fc40b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.056238:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa312b1a/0xbead52e175fc40b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.056246:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa312b1a/0xbead52e175fc40b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.056289:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869826.056535:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869826.056541:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa312b1a/0xbead52e175fc40b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.056560:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9e200 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.056564:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa312b1a/0xbead52e175fc40b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.056572:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa312b1a/0xbead52e175fc40b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.056585:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa312b1a/0xbead52e175fc40b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.056592:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa312b1a/0xbead52e175fc40b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.056608:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.056610:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.056612:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869826.056912:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.056918:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071b8f707/0xbead52e175fc40be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.056931:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1788869826.056934:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.056939:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071b8f707/0xbead52e175fc40be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.056948:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071b8f707/0xbead52e175fc40be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.056956:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071b8f707/0xbead52e175fc40be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.056964:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071b8f707/0xbead52e175fc40be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.057017:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788869826.057384:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.057390:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc40c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.057398:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1788869826.057401:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.057405:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc40c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.057414:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc40c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.057433:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc40c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.057440:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc40c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.061865:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869826.061881:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071b8f707/0xbead52e175fc40be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.061895:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9fe00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869826.061900:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071b8f707/0xbead52e175fc40be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.061926:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071b8f707/0xbead52e175fc40be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.061947:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071b8f707/0xbead52e175fc40be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.061955:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071b8f707/0xbead52e175fc40be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.061982:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869826.061986:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc40c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.061992:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535600 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869826.061995:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc40c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.062002:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc40c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.062012:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc40c5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.062019:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.062020:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.062028:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869826.062136:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869826.062143:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001758247f/0xbead52e175fc40cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.062156:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788869826.062161:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869826.062167:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001758247f/0xbead52e175fc40cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.062183:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001758247f/0xbead52e175fc40cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.062191:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001758247f/0xbead52e175fc40cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.062199:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001758247f/0xbead52e175fc40cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.062217:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869826.062225:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869826.062229:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001758247f/0xbead52e175fc40cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.062235:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1600 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869826.062238:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001758247f/0xbead52e175fc40cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.062280:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001758247f/0xbead52e175fc40cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.062292:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001758247f/0xbead52e175fc40cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.062299:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001758247f/0xbead52e175fc40cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.062311:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.062313:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.062314:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.063033:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788869826.063041:0:18669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc40c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.063220:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869826.063426:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.063432:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000727950fb/0xbead52e175fc40d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.063443:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1788869826.063447:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.063452:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000727950fb/0xbead52e175fc40d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.063464:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000727950fb/0xbead52e175fc40d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.063473:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000727950fb/0xbead52e175fc40d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788869826.063620:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869826.063626:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc40da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.063635:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788869826.063637:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869826.063642:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc40da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.063651:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc40da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.063659:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc40da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.063672:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc40da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.063693:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869826.063818:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869826.063825:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc40da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.063843:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1200 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.063847:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc40da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.063855:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc40da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.063877:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc40da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.063884:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072a9ba5c/0xbead52e175fc40da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.063900:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.063901:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.063903:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869826.064387:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869826.064394:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000302964ca/0xbead52e175fc40e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.064404:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788869826.064408:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869826.064412:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000302964ca/0xbead52e175fc40e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.064421:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000302964ca/0xbead52e175fc40e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.064429:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000302964ca/0xbead52e175fc40e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.064436:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000302964ca/0xbead52e175fc40e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.064562:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869826.064941:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000727950fb/0xbead52e175fc40d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788869826.066722:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869826.066734:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc40e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.066756:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788869826.066760:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869826.066767:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc40e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.066780:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc40e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.066790:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc40e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.066798:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc40e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.067650:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788869826.067660:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000302964ca/0xbead52e175fc40e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.067671:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1a00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.067676:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000302964ca/0xbead52e175fc40e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.067684:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000302964ca/0xbead52e175fc40e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.067700:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000302964ca/0xbead52e175fc40e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.067708:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000302964ca/0xbead52e175fc40e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.067737:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869826.067741:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000727950fb/0xbead52e175fc40d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.067747:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534e00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.067750:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000727950fb/0xbead52e175fc40d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.067757:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000727950fb/0xbead52e175fc40d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.067767:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000727950fb/0xbead52e175fc40d3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.067775:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869826.067778:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc40e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.067783:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1800 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.067785:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc40e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.067792:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc40e8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.067811:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc40e8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.067817:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.067819:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.067820:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.069397:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788869826.069409:0:18669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000727950fb/0xbead52e175fc40d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.069818:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788869826.069825:0:19213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc40e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788869826.071751:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869826.071764:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001758247f/0xbead52e175fc40ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.071780:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788869826.071785:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869826.071791:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001758247f/0xbead52e175fc40ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.071817:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001758247f/0xbead52e175fc40ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.071827:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001758247f/0xbead52e175fc40ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.071835:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001758247f/0xbead52e175fc40ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.071846:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869826.072127:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869826.072135:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001758247f/0xbead52e175fc40ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.072144:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1600 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869826.072152:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001758247f/0xbead52e175fc40ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.072161:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001758247f/0xbead52e175fc40ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.072180:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001758247f/0xbead52e175fc40ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.072188:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001758247f/0xbead52e175fc40ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.072204:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.072211:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.072212:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869826.072315:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869826.072320:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c4043ac/0xbead52e175fc40f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.072329:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788869826.072332:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869826.072336:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c4043ac/0xbead52e175fc40f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.072345:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c4043ac/0xbead52e175fc40f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.072352:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c4043ac/0xbead52e175fc40f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.072369:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c4043ac/0xbead52e175fc40f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.072384:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869826.072603:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869826.072609:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c4043ac/0xbead52e175fc40f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.072615:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1000 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869826.072619:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c4043ac/0xbead52e175fc40f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.072626:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c4043ac/0xbead52e175fc40f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.072637:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c4043ac/0xbead52e175fc40f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.072644:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c4043ac/0xbead52e175fc40f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.072657:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.072658:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.072660:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.072721:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869826.073431:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869826.073440:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e683d0e8/0xbead52e175fc40fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.073451:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=443s v=(0 0) 00010000:00010000:2.0:1788869826.073455:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869826.073460:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e683d0e8/0xbead52e175fc40fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.073471:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e683d0e8/0xbead52e175fc40fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.073480:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e683d0e8/0xbead52e175fc40fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869826.073613:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.073618:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc4104 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.073626:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1788869826.073628:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.073638:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc4104 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.073648:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc4104 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.073655:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc4104 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.073663:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc4104 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.073681:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869826.073841:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e683d0e8/0xbead52e175fc40fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.073865:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788869826.073995:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869826.074001:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc4104 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.074008:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535600 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869826.074012:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc4104 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.074020:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc4104 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.074034:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc4104 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.074051:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc4104 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.074074:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869826.074078:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e683d0e8/0xbead52e175fc40fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.074085:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1400 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869826.074088:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e683d0e8/0xbead52e175fc40fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.074094:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e683d0e8/0xbead52e175fc40fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.074105:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e683d0e8/0xbead52e175fc40fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.074112:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e683d0e8/0xbead52e175fc40fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.074127:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.074128:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.074130:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.074203:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869826.075408:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.075419:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb1096e4/0xbead52e175fc410b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.075439:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.075443:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.075448:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb1096e4/0xbead52e175fc410b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.075461:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb1096e4/0xbead52e175fc410b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.075471:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb1096e4/0xbead52e175fc410b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.075479:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb1096e4/0xbead52e175fc410b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.075581:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788869826.075824:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869826.075830:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc4112 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.075844:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788869826.075846:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869826.075851:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc4112 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.075862:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc4112 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.075868:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc4112 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.075875:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc4112 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.075896:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788869826.076031:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869826.076038:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb1096e4/0xbead52e175fc410b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.076047:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534000 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869826.076051:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb1096e4/0xbead52e175fc410b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.076058:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb1096e4/0xbead52e175fc410b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.076085:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb1096e4/0xbead52e175fc410b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.076092:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb1096e4/0xbead52e175fc410b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.076111:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869826.076116:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc4112 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.076123:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1800 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869826.076126:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc4112 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.076133:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc4112 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.076143:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc4112 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.076150:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc4112 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.076162:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.076164:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.076172:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.076220:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869826.079431:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.079447:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000727950fb/0xbead52e175fc4119 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.079465:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.079469:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.079475:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000727950fb/0xbead52e175fc4119 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.080607:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000727950fb/0xbead52e175fc4119 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.080630:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000727950fb/0xbead52e175fc4119 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.080640:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000727950fb/0xbead52e175fc4119 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.080671:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869826.080937:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869826.080946:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000727950fb/0xbead52e175fc4119 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.080954:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534e00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869826.080959:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000727950fb/0xbead52e175fc4119 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.080968:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000727950fb/0xbead52e175fc4119 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.080999:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000727950fb/0xbead52e175fc4119 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.081007:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000727950fb/0xbead52e175fc4119 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.081048:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.081050:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.081053:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869826.081106:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.081112:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eccb1675/0xbead52e175fc4120 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.081122:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.081125:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.081129:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eccb1675/0xbead52e175fc4120 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.081148:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eccb1675/0xbead52e175fc4120 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.081154:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eccb1675/0xbead52e175fc4120 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.081158:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eccb1675/0xbead52e175fc4120 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.081178:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869826.081615:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869826.081621:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eccb1675/0xbead52e175fc4120 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.081630:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534800 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869826.081634:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eccb1675/0xbead52e175fc4120 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869826.081642:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869826.081643:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eccb1675/0xbead52e175fc4120 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.081654:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f147454f/0xbead52e175fc4127 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.081661:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eccb1675/0xbead52e175fc4120 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.081665:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.081674:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869826.081675:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eccb1675/0xbead52e175fc4120 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.081680:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f147454f/0xbead52e175fc4127 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.081694:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f147454f/0xbead52e175fc4127 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.081705:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f147454f/0xbead52e175fc4127 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.081710:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.081712:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.081714:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.081725:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f147454f/0xbead52e175fc4127 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.081743:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869826.081753:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869826.081758:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f147454f/0xbead52e175fc4127 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.081766:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535800 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869826.081769:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f147454f/0xbead52e175fc4127 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.081776:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f147454f/0xbead52e175fc4127 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.081786:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f147454f/0xbead52e175fc4127 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.081793:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f147454f/0xbead52e175fc4127 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.081810:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.081813:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.081814:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869826.083452:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.083464:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098b72576/0xbead52e175fc412e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.083479:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.083483:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.083488:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098b72576/0xbead52e175fc412e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.083499:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098b72576/0xbead52e175fc412e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.083519:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098b72576/0xbead52e175fc412e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.083527:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098b72576/0xbead52e175fc412e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.083554:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788869826.084421:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.084429:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049a8118b/0xbead52e175fc4135 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.084446:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.084449:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.084453:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049a8118b/0xbead52e175fc4135 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.084463:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049a8118b/0xbead52e175fc4135 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.084472:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049a8118b/0xbead52e175fc4135 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.084480:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049a8118b/0xbead52e175fc4135 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.084501:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788869826.084526:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869826.084532:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098b72576/0xbead52e175fc412e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.084541:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535a00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869826.084546:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098b72576/0xbead52e175fc412e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.084554:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098b72576/0xbead52e175fc412e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.084594:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098b72576/0xbead52e175fc412e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.084601:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098b72576/0xbead52e175fc412e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.084621:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869826.084624:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049a8118b/0xbead52e175fc4135 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.084631:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534a00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869826.084634:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049a8118b/0xbead52e175fc4135 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.084642:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049a8118b/0xbead52e175fc4135 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.084651:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049a8118b/0xbead52e175fc4135 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.084658:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049a8118b/0xbead52e175fc4135 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.084671:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.084673:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.084680:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869826.085410:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.085418:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e336a97e/0xbead52e175fc413c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.085427:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.085431:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.085436:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e336a97e/0xbead52e175fc413c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.085446:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e336a97e/0xbead52e175fc413c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.085454:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e336a97e/0xbead52e175fc413c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.085460:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e336a97e/0xbead52e175fc413c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.085475:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869826.085485:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869826.085489:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e336a97e/0xbead52e175fc413c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.085497:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534200 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869826.085500:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e336a97e/0xbead52e175fc413c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.085533:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e336a97e/0xbead52e175fc413c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.085545:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e336a97e/0xbead52e175fc413c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.085551:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e336a97e/0xbead52e175fc413c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.085567:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.085569:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.085571:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.085666:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869826.085986:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.085992:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc4143 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.086002:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.086006:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.086010:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc4143 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.086019:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc4143 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.086027:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc4143 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.086040:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc4143 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.086066:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869826.086296:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869826.086303:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc4143 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.086319:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534600 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869826.086323:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc4143 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.086331:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc4143 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.086344:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc4143 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.086351:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a3857aa/0xbead52e175fc4143 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.086371:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.086373:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.086375:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869826.086382:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.086389:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ada184bb/0xbead52e175fc414a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.086397:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.086401:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.086404:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ada184bb/0xbead52e175fc414a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.086414:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ada184bb/0xbead52e175fc414a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.086422:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ada184bb/0xbead52e175fc414a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.086429:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ada184bb/0xbead52e175fc414a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.086449:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869826.086581:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869826.086586:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ada184bb/0xbead52e175fc414a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.086594:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535400 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869826.086598:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ada184bb/0xbead52e175fc414a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.086606:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ada184bb/0xbead52e175fc414a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.086624:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ada184bb/0xbead52e175fc414a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.086631:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ada184bb/0xbead52e175fc414a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.086646:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.086647:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.086649:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869826.087069:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.087076:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000705a0d9f/0xbead52e175fc4151 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.087091:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.087094:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.087099:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000705a0d9f/0xbead52e175fc4151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.087108:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000705a0d9f/0xbead52e175fc4151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.087116:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000705a0d9f/0xbead52e175fc4151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.087123:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000705a0d9f/0xbead52e175fc4151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.087145:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869826.087300:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869826.087306:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000705a0d9f/0xbead52e175fc4151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.087315:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535200 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869826.087319:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000705a0d9f/0xbead52e175fc4151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.087327:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000705a0d9f/0xbead52e175fc4151 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.087339:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000705a0d9f/0xbead52e175fc4151 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.087345:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000705a0d9f/0xbead52e175fc4151 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.087376:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.087379:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.087381:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869826.087440:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.087446:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b885c084/0xbead52e175fc4158 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.087455:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.087458:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.087462:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b885c084/0xbead52e175fc4158 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.087471:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b885c084/0xbead52e175fc4158 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.087491:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b885c084/0xbead52e175fc4158 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.087499:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b885c084/0xbead52e175fc4158 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.087531:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869826.087589:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869826.087595:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b885c084/0xbead52e175fc4158 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.087603:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81490e00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869826.087606:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b885c084/0xbead52e175fc4158 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.087614:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b885c084/0xbead52e175fc4158 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.087625:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b885c084/0xbead52e175fc4158 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.087632:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b885c084/0xbead52e175fc4158 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.087648:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.087649:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.087651:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869826.087689:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869826.087696:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc415f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.087704:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788869826.087708:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869826.087712:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc415f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.087722:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc415f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.087729:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc415f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.087737:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc415f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.087804:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788869826.087917:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.087924:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e498504e/0xbead52e175fc4166 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.087933:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.087936:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.087940:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e498504e/0xbead52e175fc4166 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.087950:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e498504e/0xbead52e175fc4166 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.087957:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e498504e/0xbead52e175fc4166 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.087964:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e498504e/0xbead52e175fc4166 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.088729:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788869826.088793:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869826.088801:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc415f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.088813:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05400 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.088818:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc415f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.088827:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc415f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.088841:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc415f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.088849:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edb0f169/0xbead52e175fc415f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.088866:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869826.088870:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e498504e/0xbead52e175fc4166 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.088877:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81491600 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.088880:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e498504e/0xbead52e175fc4166 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.088900:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e498504e/0xbead52e175fc4166 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.088912:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e498504e/0xbead52e175fc4166 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.088919:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e498504e/0xbead52e175fc4166 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.088938:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.088939:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.088941:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869826.088995:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869826.089001:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012216c14/0xbead52e175fc416d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.089009:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788869826.089011:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869826.089015:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012216c14/0xbead52e175fc416d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.089022:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012216c14/0xbead52e175fc416d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.089026:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012216c14/0xbead52e175fc416d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.089037:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012216c14/0xbead52e175fc416d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.089045:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788869826.089734:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869826.089741:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e843171a/0xbead52e175fc4174 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.089752:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788869826.089755:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869826.089759:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e843171a/0xbead52e175fc4174 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.089768:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e843171a/0xbead52e175fc4174 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.089775:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e843171a/0xbead52e175fc4174 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.089782:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e843171a/0xbead52e175fc4174 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.089795:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788869826.089802:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869826.089805:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012216c14/0xbead52e175fc416d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.089819:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05200 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.089822:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012216c14/0xbead52e175fc416d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.089830:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012216c14/0xbead52e175fc416d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.089842:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012216c14/0xbead52e175fc416d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.089850:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012216c14/0xbead52e175fc416d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.089865:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869826.089868:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e843171a/0xbead52e175fc4174 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.089875:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05e00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.089878:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e843171a/0xbead52e175fc4174 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.089885:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e843171a/0xbead52e175fc4174 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.089895:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e843171a/0xbead52e175fc4174 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.089910:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e843171a/0xbead52e175fc4174 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.089923:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.089925:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.089927:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869826.090290:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869826.090296:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd3affe2/0xbead52e175fc417b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.090304:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788869826.090307:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869826.090311:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd3affe2/0xbead52e175fc417b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.090320:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd3affe2/0xbead52e175fc417b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.090328:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd3affe2/0xbead52e175fc417b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.090334:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd3affe2/0xbead52e175fc417b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.090346:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869826.090351:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869826.090361:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd3affe2/0xbead52e175fc417b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.090367:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04a00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.090370:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd3affe2/0xbead52e175fc417b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.090377:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd3affe2/0xbead52e175fc417b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.090387:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd3affe2/0xbead52e175fc417b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.090394:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd3affe2/0xbead52e175fc417b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.090404:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.090406:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.090407:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869826.090690:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869826.090696:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bfa7286/0xbead52e175fc4182 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.090704:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788869826.090707:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869826.090711:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bfa7286/0xbead52e175fc4182 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.090732:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bfa7286/0xbead52e175fc4182 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.090741:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bfa7286/0xbead52e175fc4182 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.090748:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bfa7286/0xbead52e175fc4182 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.090760:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869826.090765:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869826.090767:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bfa7286/0xbead52e175fc4182 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.090772:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04e00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.090774:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bfa7286/0xbead52e175fc4182 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.090779:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bfa7286/0xbead52e175fc4182 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.090785:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bfa7286/0xbead52e175fc4182 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.090789:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bfa7286/0xbead52e175fc4182 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.090805:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.090807:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.090808:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869826.090963:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.090971:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec999752/0xbead52e175fc4189 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.090981:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.090984:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.090988:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec999752/0xbead52e175fc4189 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.090998:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec999752/0xbead52e175fc4189 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.091006:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec999752/0xbead52e175fc4189 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.091013:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec999752/0xbead52e175fc4189 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.091038:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869826.091344:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869826.091350:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec999752/0xbead52e175fc4189 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.091359:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81490800 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.091362:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec999752/0xbead52e175fc4189 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.091370:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec999752/0xbead52e175fc4189 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.091384:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec999752/0xbead52e175fc4189 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.091392:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec999752/0xbead52e175fc4189 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.091409:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.091411:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.091412:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869826.091427:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.091434:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008e31d89/0xbead52e175fc4190 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.091442:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.091452:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.091456:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008e31d89/0xbead52e175fc4190 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.091466:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008e31d89/0xbead52e175fc4190 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.091473:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008e31d89/0xbead52e175fc4190 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.091479:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008e31d89/0xbead52e175fc4190 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.091516:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788869826.091654:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.091660:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000236f6304/0xbead52e175fc4197 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.091667:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.091670:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.091674:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000236f6304/0xbead52e175fc4197 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.091682:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000236f6304/0xbead52e175fc4197 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.091689:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000236f6304/0xbead52e175fc4197 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.091702:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000236f6304/0xbead52e175fc4197 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.091710:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788869826.092441:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869826.092448:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008e31d89/0xbead52e175fc4190 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.092468:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81491a00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.092471:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008e31d89/0xbead52e175fc4190 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.092480:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008e31d89/0xbead52e175fc4190 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.092493:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008e31d89/0xbead52e175fc4190 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.092500:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008e31d89/0xbead52e175fc4190 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.092527:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869826.092531:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000236f6304/0xbead52e175fc4197 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.092537:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81490a00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.092541:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000236f6304/0xbead52e175fc4197 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.092548:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000236f6304/0xbead52e175fc4197 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.092558:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000236f6304/0xbead52e175fc4197 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.092572:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000236f6304/0xbead52e175fc4197 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.092586:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.092588:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.092589:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869826.093778:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.093793:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8e667c7/0xbead52e175fc419e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788869826.093793:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869826.093804:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004282839f/0xbead52e175fc41a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.093814:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788869826.093816:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.093821:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869826.093823:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.093833:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8e667c7/0xbead52e175fc419e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.093833:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004282839f/0xbead52e175fc41a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.093866:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8e667c7/0xbead52e175fc419e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.093867:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004282839f/0xbead52e175fc41a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.093894:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8e667c7/0xbead52e175fc419e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.093894:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004282839f/0xbead52e175fc41a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.093920:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004282839f/0xbead52e175fc41a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.093921:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8e667c7/0xbead52e175fc419e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.093954:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869826.094043:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869826.094049:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8e667c7/0xbead52e175fc419e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.094065:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81491400 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.094069:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8e667c7/0xbead52e175fc419e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.094077:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8e667c7/0xbead52e175fc419e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.094177:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8e667c7/0xbead52e175fc419e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.094185:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8e667c7/0xbead52e175fc419e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.094204:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.094205:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.094207:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.094222:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869826.094229:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869826.094232:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004282839f/0xbead52e175fc41a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.094238:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05800 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.094241:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004282839f/0xbead52e175fc41a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.094282:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004282839f/0xbead52e175fc41a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.094293:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004282839f/0xbead52e175fc41a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.094299:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004282839f/0xbead52e175fc41a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.094320:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.094321:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.094323:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869826.094461:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.094467:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3ad055c/0xbead52e175fc41ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.094482:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788869826.094731:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.094737:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.094759:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.094766:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3ad055c/0xbead52e175fc41ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.094776:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3ad055c/0xbead52e175fc41ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.094784:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3ad055c/0xbead52e175fc41ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.094790:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3ad055c/0xbead52e175fc41ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.094805:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788869826.095059:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.095066:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b112619d/0xbead52e175fc41b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.095075:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.095078:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.095083:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b112619d/0xbead52e175fc41b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.095091:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b112619d/0xbead52e175fc41b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.095110:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b112619d/0xbead52e175fc41b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.095118:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b112619d/0xbead52e175fc41b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.095175:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788869826.095434:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.095440:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc41ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.095447:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.095450:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.095454:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc41ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.095464:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc41ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.095471:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc41ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.095478:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc41ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.098425:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788869826.098447:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3ad055c/0xbead52e175fc41ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.098448:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869826.098463:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81490000 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869826.098469:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3ad055c/0xbead52e175fc41ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.098481:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3ad055c/0xbead52e175fc41ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.098682:0:19700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869826.098691:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b112619d/0xbead52e175fc41b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.098700:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81491200 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.098703:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b112619d/0xbead52e175fc41b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.098711:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b112619d/0xbead52e175fc41b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.098730:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b112619d/0xbead52e175fc41b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.098744:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b112619d/0xbead52e175fc41b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.098769:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.098771:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.098772:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.099439:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3ad055c/0xbead52e175fc41ac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.099448:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3ad055c/0xbead52e175fc41ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.099465:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.099467:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.099470:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.099655:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.099678:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00080000:3.0:1788869826.099785:0:18669:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:3.0:1788869826.099901:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17185:x1875765554774272:12345-0@lo:5:osp-pre-0-0.0 Request processed in 84698us (86074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869826.099913:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869826.099946:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869826.099962:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17905:x1875765554774528:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788869826.099962:0:17185:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb11880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17185:1875765554774272:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788869826.099989:0:17185:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:0.0:1788869826.100052:0:17185:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8335c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17185:1875765554774656:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788869826.100109:0:17185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869826.100138:0:17185:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89c61240 going to sleep for 11 seconds 00000100:00100000:0.0:1788869826.100154:0:18668:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788869826.100162:0:18668:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00010000:2.0:1788869826.101672:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869826.101684:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0f430df/0xbead52e175fc41c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.101701:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788869826.101706:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869826.101712:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0f430df/0xbead52e175fc41c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.101741:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0f430df/0xbead52e175fc41c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.101752:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0f430df/0xbead52e175fc41c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.101761:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0f430df/0xbead52e175fc41c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.101785:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869826.101928:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869826.101934:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0f430df/0xbead52e175fc41c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.101943:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1c00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.101948:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0f430df/0xbead52e175fc41c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.101958:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0f430df/0xbead52e175fc41c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.101987:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0f430df/0xbead52e175fc41c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.101996:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0f430df/0xbead52e175fc41c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.102013:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.102015:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.102016:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869826.102473:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554774656 00000100:00100000:0.0:1788869826.102484:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554774656 00000100:00100000:0.0:1788869826.102606:0:19702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788869826.102612:0:19702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17185:x1875765554774656:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788869826.102653:0:19702:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00002000:00010000:2.0:1788869826.102723:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869826.102731:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc41c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.102744:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788869826.102748:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869826.102753:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc41c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.102763:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc41c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.102772:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc41c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.102791:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc41c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.102813:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869826.102986:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869826.102992:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc41c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.103001:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1800 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.103004:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc41c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.103013:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc41c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.103023:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc41c8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.103033:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039cc6764/0xbead52e175fc41c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.103044:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.103045:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.103046:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869826.104335:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869826.104345:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e683d0e8/0xbead52e175fc41cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.104360:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788869826.104364:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869826.104370:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e683d0e8/0xbead52e175fc41cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.104382:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e683d0e8/0xbead52e175fc41cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.104391:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e683d0e8/0xbead52e175fc41cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.104399:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e683d0e8/0xbead52e175fc41cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.104418:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869826.104429:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869826.104434:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e683d0e8/0xbead52e175fc41cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.104448:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1400 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869826.104452:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e683d0e8/0xbead52e175fc41cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.104460:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e683d0e8/0xbead52e175fc41cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.104474:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e683d0e8/0xbead52e175fc41cf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.104482:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e683d0e8/0xbead52e175fc41cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.105631:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.105634:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.105637:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869826.106773:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869826.106785:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c4043ac/0xbead52e175fc41d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.106804:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788869826.106809:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869826.106816:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c4043ac/0xbead52e175fc41d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.106830:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c4043ac/0xbead52e175fc41d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.106848:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c4043ac/0xbead52e175fc41d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.106856:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c4043ac/0xbead52e175fc41d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.106877:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869826.106887:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869826.106892:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c4043ac/0xbead52e175fc41d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.106900:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1000 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869826.106904:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c4043ac/0xbead52e175fc41d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.106913:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c4043ac/0xbead52e175fc41d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.106931:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c4043ac/0xbead52e175fc41d6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.106940:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c4043ac/0xbead52e175fc41d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.106957:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.106965:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.106967:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788869826.107241:0:18669:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788869826.107247:0:18669:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788869826.107367:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17905:x1875765554774528:12345-0@lo:7:osp-pre-1-1.0 Request processed in 7408us (92949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869826.107378:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869826.107440:0:17905:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb13b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17905:1875765554774528:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788869826.107456:0:17905:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788869826.108632:0:17905:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb13b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17905:1875765554774784:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788869826.108687:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869826.108721:0:17905:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89379600 going to sleep for 11 seconds 00000100:00100000:3.0:1788869826.108747:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554774784 00000100:00100000:3.0:1788869826.108754:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554774784 00000100:00100000:3.0:1788869826.108808:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788869826.109595:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17905:x1875765554774784:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788869826.109637:0:18669:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788869826.109774:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17905:x1875765554774784:12345-0@lo:5:osp-pre-1-1.0 Request processed in 957us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869826.109783:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1788869826.109869:0:19701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.109872:0:19701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.109874:0:19701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869826.110907:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.110919:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e336a97e/0xbead52e175fc41dd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.110937:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.110942:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.110951:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e336a97e/0xbead52e175fc41dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.110964:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e336a97e/0xbead52e175fc41dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.110974:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e336a97e/0xbead52e175fc41dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.110984:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e336a97e/0xbead52e175fc41dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.111000:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788869826.112074:0:17905:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb13b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17905:1875765554774784:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788869826.112096:0:17905:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788869826.112229:0:17905:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8335ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17905:1875765554774912:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788869826.112307:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869826.112336:0:17905:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff8cbbc6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788869826.112355:0:19700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc41ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.112367:0:19700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535600 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.112371:0:19700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc41ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.112383:0:19700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc41ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.112405:0:19700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc41ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.112485:0:19700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad707d53/0xbead52e175fc41ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.112515:0:19700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869826.112520:0:19700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e336a97e/0xbead52e175fc41dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.112526:0:19700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534200 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.112529:0:19700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e336a97e/0xbead52e175fc41dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.112537:0:19700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e336a97e/0xbead52e175fc41dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.112547:0:19700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e336a97e/0xbead52e175fc41dd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.112554:0:19700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e336a97e/0xbead52e175fc41dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.112567:0:19700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.112569:0:19700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.112572:0:19700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869826.112592:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554774912 00000100:00100000:0.0:1788869826.112599:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554774912 00000100:00100000:0.0:1788869826.112652:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788869826.112669:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17905:x1875765554774912:12345-0@lo:5:osp-pre-1-1.0 00000001:00080000:2.0:1788869826.112695:0:18663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00002000:00080000:0.0:1788869826.112717:0:18668:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000001:00100000:2.0:1788869826.112738:0:18663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788869826.112757:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869826.112912:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.112920:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049a8118b/0xbead52e175fc41e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.112932:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.112936:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.112947:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049a8118b/0xbead52e175fc41e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.112959:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049a8118b/0xbead52e175fc41e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.112967:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049a8118b/0xbead52e175fc41e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.112974:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049a8118b/0xbead52e175fc41e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.112996:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788869826.113080:0:19702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17185:x1875765554774656:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10466us (12982us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788869826.113089:0:19702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788869826.113128:0:17185:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788869826.113135:0:17185:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8335c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17185:1875765554774656:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788869826.113145:0:17185:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:2.0:1788869826.113345:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869826.113352:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049a8118b/0xbead52e175fc41e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.113360:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534a00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869826.113363:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049a8118b/0xbead52e175fc41e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.113370:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049a8118b/0xbead52e175fc41e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.113383:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049a8118b/0xbead52e175fc41e4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.113391:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049a8118b/0xbead52e175fc41e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.113408:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.113410:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.113413:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869826.118571:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.118586:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098b72576/0xbead52e175fc41eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.118603:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.118608:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.118614:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098b72576/0xbead52e175fc41eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.118626:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098b72576/0xbead52e175fc41eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.118635:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098b72576/0xbead52e175fc41eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.118652:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098b72576/0xbead52e175fc41eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.118673:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788869826.119728:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.119737:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb1096e4/0xbead52e175fc41f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.119750:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.119754:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.119758:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb1096e4/0xbead52e175fc41f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.119768:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb1096e4/0xbead52e175fc41f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.119776:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb1096e4/0xbead52e175fc41f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.119782:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb1096e4/0xbead52e175fc41f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.119795:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788869826.120451:0:19700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869826.120461:0:19700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098b72576/0xbead52e175fc41eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.120471:0:19700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535a00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.120476:0:19700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098b72576/0xbead52e175fc41eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.120485:0:19700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098b72576/0xbead52e175fc41eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.120504:0:19700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098b72576/0xbead52e175fc41eb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.120522:0:19700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098b72576/0xbead52e175fc41eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.120544:0:19700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869826.120556:0:19700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb1096e4/0xbead52e175fc41f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.120562:0:19700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534000 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869826.120565:0:19700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb1096e4/0xbead52e175fc41f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.120572:0:19700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb1096e4/0xbead52e175fc41f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.120583:0:19700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb1096e4/0xbead52e175fc41f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.120591:0:19700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb1096e4/0xbead52e175fc41f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.120606:0:19700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.120608:0:19700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.120611:0:19700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869826.120620:0:19701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869826.120790:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.120797:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000705a0d9f/0xbead52e175fc41f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.120811:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.120814:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.120819:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000705a0d9f/0xbead52e175fc41f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.120829:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000705a0d9f/0xbead52e175fc41f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.120836:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000705a0d9f/0xbead52e175fc41f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.120843:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000705a0d9f/0xbead52e175fc41f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.120858:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869826.122113:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869826.122124:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000705a0d9f/0xbead52e175fc41f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.122151:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535200 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869826.122155:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000705a0d9f/0xbead52e175fc41f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.122164:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000705a0d9f/0xbead52e175fc41f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.122181:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000705a0d9f/0xbead52e175fc41f9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.122189:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000705a0d9f/0xbead52e175fc41f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.122207:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.122209:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.122210:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869826.122236:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869826.122243:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc4200 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.122481:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788869826.122654:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869826.122662:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc4200 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.122673:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc4200 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.122696:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc4200 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.122704:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc4200 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.122790:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869826.122836:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869826.122842:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc4200 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.122851:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535400 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869826.122855:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc4200 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.122863:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc4200 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.122883:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc4200 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.122891:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ada184bb/0xbead52e175fc4200 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869826.122907:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.122909:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869826.122911:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869826.123205:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869826.123212:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc4207 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.123221:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788869826.123225:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869826.123229:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc4207 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.123248:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc4207 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.123275:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc4207 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.123283:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc4207 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.123300:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869826.123590:0:19700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869826.123596:0:19700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc4207 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.123603:0:19700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05800 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869826.123605:0:19700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc4207 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.123612:0:19700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc4207 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.123623:0:19700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc4207 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.123630:0:19700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004282839f/0xbead52e175fc4207 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.123644:0:19700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.123646:0:19700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.123654:0:19700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869826.123720:0:19213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869826.123727:0:19213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bfa7286/0xbead52e175fc420e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.123736:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788869826.123740:0:19213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869826.123743:0:19213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bfa7286/0xbead52e175fc420e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.123754:0:19213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bfa7286/0xbead52e175fc420e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.123762:0:19213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bfa7286/0xbead52e175fc420e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.123782:0:19213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bfa7286/0xbead52e175fc420e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869826.123813:0:19213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869826.123840:0:19701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869826.123847:0:19701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bfa7286/0xbead52e175fc420e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788869826.123847:0:19213:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00010000:00010000:3.0:1788869826.123858:0:19701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb04e00 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869826.123862:0:19701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bfa7286/0xbead52e175fc420e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.123870:0:19701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bfa7286/0xbead52e175fc420e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.123882:0:19701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bfa7286/0xbead52e175fc420e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.123889:0:19701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bfa7286/0xbead52e175fc420e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869826.123904:0:19701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.123907:0:19701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869826.123909:0:19701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869826.123949:0:19213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17187:x1875765554774016:12345-0@lo:5:osp-pre-1-0.0 Request processed in 108999us (110922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869826.123959:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869826.124190:0:17187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8401ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17187:1875765554774016:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788869826.124209:0:17187:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1788869826.124697:0:17187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb11c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17187:1875765554775040:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788869826.124753:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869826.124784:0:17187:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89379900 going to sleep for 11 seconds 00000100:00100000:2.0:1788869826.124879:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554775040 00000100:00100000:2.0:1788869826.124886:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554775040 00000100:00100000:2.0:1788869826.124937:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788869826.124947:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17187:x1875765554775040:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788869826.124988:0:18667:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000001:00080000:0.0:1788869826.142553:0:19482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788869826.142598:0:19482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788869826.142602:0:19482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788869826.142769:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17187:x1875765554775040:12345-0@lo:5:osp-pre-1-0.0 Request processed in 17820us (18011us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788869826.142780:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788869826.144855:0:17187:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788869826.144867:0:17187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb11c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17187:1875765554775040:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788869826.144885:0:17187:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:0.0:1788869826.150458:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17905:x1875765554774912:12345-0@lo:5:osp-pre-1-1.0 Request processed in 37784us (38144us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788869826.150471:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788869826.150940:0:17905:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8335ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17905:1875765554774912:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788869826.150957:0:17905:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788869826.151005:0:17905:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb11c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17905:1875765554775168:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788869826.151047:0:17905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869826.151998:0:17905:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff89379240 going to sleep for 11 seconds 00000100:00100000:0.0:1788869826.152058:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554775168 00000100:00100000:0.0:1788869826.152066:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554775168 00000100:00100000:2.0:1788869826.152599:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869826.152615:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17905:x1875765554775168:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788869826.152715:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17905:x1875765554775168:12345-0@lo:900:osp-pre-1-1.0 Request processed in 107us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869826.152722:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788869826.152834:0:17905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffbfb11c00 x1875765554775168/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788869842 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869826.152917:0:17905:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb11c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17905:1875765554775168:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1788869826.392816:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869827.416464:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869828.440538:0:19700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869828.504505:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554775296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869828.504583:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869828.504738:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554775296 00000100:00100000:1.0:1788869828.504745:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554775296 00000100:00100000:1.0:1788869828.504812:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869828.504822:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8401ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554775296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869828.504852:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788869828.504896:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8401ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554775296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869828.504902:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788869828.504966:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869828.505077:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554775296:0@lo:13:osp-pre-0-1.0 00000001:02000400:1.0:1788869828.672768:0:19841:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788869829.476171:0:19701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788869829.521876:0:19894:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788869829.522198:0:19894:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788869829.528497:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869829.528521:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554775424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869829.528601:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869829.528668:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554775424 00000100:00100000:0.0:1788869829.528675:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554775424 00000100:00100000:0.0:1788869829.528716:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788869829.528725:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554775424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869829.528758:0:17166:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788869829.528798:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554775424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869829.528805:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788869829.528859:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554775424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869829.529023:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869829.529032:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554775552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869829.529060:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869829.529085:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554775552 00000100:00100000:1.0:1788869829.529089:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554775552 00000100:00100000:1.0:1788869829.529112:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788869829.529118:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554775552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869829.529134:0:17165:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788869829.529167:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554775552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869829.529174:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788869829.529199:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554775552:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1788869830.319837:0:19944:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788869830.320094:0:19944:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788869830.488668:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869830.591859:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869830.591982:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545258624 00000100:00100000:2.0:1788869830.591993:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545258624 00000100:00100000:2.0:1788869830.592045:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 113 00000100:00100000:2.0:1788869830.592054:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2386:x1875765545258624:12345-192.168.201.30@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788869830.592082:0:17153:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from e10bffde-eac0-4cc8-9215-f0ed84a241b8@192.168.201.30@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:2.0:1788869830.592121:0:17153:0:(genops.c:1406:class_connect()) connect: client e10bffde-eac0-4cc8-9215-f0ed84a241b8, cookie 0xbead52e175fc4215 00000100:00080000:2.0:1788869830.592328:0:17153:0:(import.c:65:import_set_state_nolock()) ffff99fe8310b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869830.592405:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+5:2386:x1875765545258624:12345-192.168.201.30@tcp:250:mount.lustre.0 Request processed in 350us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869830.592414:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 113 00000100:00100000:3.0:1788869830.598053:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869830.598174:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545258752 00000100:00100000:0.0:1788869830.598185:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545258752 00000100:00100000:0.0:1788869830.598245:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 114 00000100:00100000:0.0:1788869830.598285:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+5:14893:x1875765545258752:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788869830.598303:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869830.598323:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffbfb04a00/0xbead52e175fc421c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaadcd expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869830.598351:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffbfb04a00/0xbead52e175fc421c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaadcd expref: 6 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869830.598361:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffbfb04a00/0xbead52e175fc421c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaadcd expref: 6 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869830.598370:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04a00, rc 0) 00000100:00100000:0.0:1788869830.598441:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+6:14893:x1875765545258752:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 187us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869830.598448:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 114 00000100:00100000:1.0:1788869830.601053:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869830.601279:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545258880 00000100:00100000:0.0:1788869830.601338:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545258880 00000100:00100000:0.0:1788869830.601412:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 115 00000100:00100000:0.0:1788869830.601422:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10bffde-eac0-4cc8-9215-f0ed84a241b8+6:14893:x1875765545258880:12345-192.168.201.30@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788869830.601793:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10bffde-eac0-4cc8-9215-f0ed84a241b8+6:14893:x1875765545258880:12345-192.168.201.30@tcp:501:mount.lustre.0 Request processed in 372us (747us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788869830.601802:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 115 00000100:00100000:3.0:1788869830.605205:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869830.613093:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545259008 00000100:00100000:2.0:1788869830.613109:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545259008 00000100:00100000:2.0:1788869830.613178:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 116 00000100:00100000:2.0:1788869830.613189:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+6:14893:x1875765545259008:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788869830.613206:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869830.613237:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fe823c1600/0xbead52e175fc4223 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaadd4 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869830.613293:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fe823c1600/0xbead52e175fc4223 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaadd4 expref: 7 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869830.613325:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fe823c1600/0xbead52e175fc4223 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaadd4 expref: 7 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869830.613334:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1600, rc 0) 00000100:00100000:2.0:1788869830.613414:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+7:14893:x1875765545259008:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 226us (8219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869830.613421:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 116 00000100:00100000:3.0:1788869830.623898:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869830.624115:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545259136 00000100:00100000:0.0:1788869830.624126:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545259136 00000100:00100000:0.0:1788869830.624237:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 117 00000100:00100000:0.0:1788869830.624247:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10bffde-eac0-4cc8-9215-f0ed84a241b8+7:14893:x1875765545259136:12345-192.168.201.30@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788869830.624458:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10bffde-eac0-4cc8-9215-f0ed84a241b8+8:14893:x1875765545259136:12345-192.168.201.30@tcp:501:mount.lustre.0 Request processed in 213us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869830.624466:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 117 00000100:00100000:0.0:1788869830.632558:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869830.632666:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545259264 00000100:00100000:1.0:1788869830.632675:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545259264 00000100:00100000:1.0:1788869830.632761:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 118 00000100:00100000:1.0:1788869830.632769:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+8:14893:x1875765545259264:12345-192.168.201.30@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788869830.632908:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+8:14893:x1875765545259264:12345-192.168.201.30@tcp:503:mount.lustre.0 Request processed in 139us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869830.632915:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 118 00000100:00100000:3.0:1788869830.636711:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869830.636855:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545259392 00000100:00100000:0.0:1788869830.636865:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545259392 00000100:00100000:0.0:1788869830.636922:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 119 00000100:00100000:0.0:1788869830.636930:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10bffde-eac0-4cc8-9215-f0ed84a241b8+8:14912:x1875765545259392:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788869830.637114:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10bffde-eac0-4cc8-9215-f0ed84a241b8+8:14912:x1875765545259392:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 184us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869830.637122:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 119 00000100:00100000:3.0:1788869830.683086:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869830.683477:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545259520 00000100:00100000:1.0:1788869830.683487:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545259520 00000100:00100000:1.0:1788869830.683563:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 120 00000100:00100000:1.0:1788869830.683573:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+8:14912:x1875765545259520:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788869830.683727:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+8:14912:x1875765545259520:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 155us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869830.683735:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 120 00000100:00100000:1.0:1788869830.690096:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869830.690493:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545259648 00000100:00100000:2.0:1788869830.690506:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545259648 00000100:00100000:2.0:1788869830.690568:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 121 00000100:00100000:2.0:1788869830.690579:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+8:14912:x1875765545259648:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869830.690744:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+8:14912:x1875765545259648:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 166us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869830.690752:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 121 00000100:00100000:3.0:1788869830.706488:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869830.707412:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545259776 00000100:00100000:0.0:1788869830.707429:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545259776 00000100:00100000:0.0:1788869830.707487:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 122 00000100:00100000:0.0:1788869830.707497:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10bffde-eac0-4cc8-9215-f0ed84a241b8+8:14893:x1875765545259776:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788869830.707526:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869830.707543:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffbfb05800/0xbead52e175fc422a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaae05 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869830.707570:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffbfb05800/0xbead52e175fc422a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae05 expref: 9 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869830.707580:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffbfb05800/0xbead52e175fc422a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae05 expref: 9 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869830.707590:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb05800, rc 0) 00000100:00100000:0.0:1788869830.707640:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10bffde-eac0-4cc8-9215-f0ed84a241b8+9:14893:x1875765545259776:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 145us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869830.707647:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 122 00000100:00100000:3.0:1788869830.719402:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869830.719754:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545259904 00000100:00100000:1.0:1788869830.719765:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545259904 00000100:00100000:1.0:1788869830.719838:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 123 00000100:00100000:1.0:1788869830.719849:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+9:14893:x1875765545259904:12345-192.168.201.30@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788869830.719877:0:17154:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788869830.720094:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788869830.720099:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788869830.720102:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788869830.720105:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788869830.720108:0:17154:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788869830.724520:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+9:14893:x1875765545259904:12345-192.168.201.30@tcp:256:mount.lustre.0 Request processed in 4662us (5116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869830.724535:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 123 00000100:00100000:3.0:1788869830.728955:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869830.729328:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545260032 00000100:00100000:2.0:1788869830.729339:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545260032 00000100:00100000:2.0:1788869830.729399:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 124 00000100:00100000:2.0:1788869830.729409:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+9:14893:x1875765545260032:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788869830.729437:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869830.729457:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fe823c1400/0xbead52e175fc4231 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaae0c expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869830.729508:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fe823c1400/0xbead52e175fc4231 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae0c expref: 10 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869830.729519:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fe823c1400/0xbead52e175fc4231 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae0c expref: 10 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869830.729529:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1400, rc 0) 00000100:00100000:2.0:1788869830.729594:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+10:14893:x1875765545260032:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 187us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869830.729602:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 124 00000100:00100000:3.0:1788869830.731202:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869830.731450:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545260160 00000100:00100000:0.0:1788869830.731459:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545260160 00000100:00100000:0.0:1788869830.731506:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 125 00000100:00100000:0.0:1788869830.731515:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10bffde-eac0-4cc8-9215-f0ed84a241b8+10:14893:x1875765545260160:12345-192.168.201.30@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788869830.731658:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10bffde-eac0-4cc8-9215-f0ed84a241b8+10:14893:x1875765545260160:12345-192.168.201.30@tcp:501:mount.lustre.0 Request processed in 143us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869830.731665:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 125 00000100:00100000:0.0:1788869830.738032:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869830.738280:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545260288 00000100:00100000:1.0:1788869830.738290:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545260288 00000100:00100000:1.0:1788869830.738349:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 126 00000100:00100000:1.0:1788869830.738360:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+10:14893:x1875765545260288:12345-192.168.201.30@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788869830.738520:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+10:14893:x1875765545260288:12345-192.168.201.30@tcp:503:mount.lustre.0 Request processed in 161us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869830.738528:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 126 00000100:00100000:3.0:1788869830.742127:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869830.743121:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545260416 00000100:00100000:2.0:1788869830.743134:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545260416 00000100:00100000:2.0:1788869830.743200:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 127 00000100:00100000:2.0:1788869830.743211:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbbd48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+10:14917:x1875765545260416:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869830.743407:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbbd48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+10:14917:x1875765545260416:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 197us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869830.743416:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 127 00000100:00100000:3.0:1788869830.755789:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869830.758485:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545260544 00000100:00100000:0.0:1788869830.758500:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545260544 00000100:00100000:0.0:1788869830.758573:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 128 00000100:00100000:0.0:1788869830.758585:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10bffde-eac0-4cc8-9215-f0ed84a241b8+10:14917:x1875765545260544:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788869830.758764:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10bffde-eac0-4cc8-9215-f0ed84a241b8+10:14917:x1875765545260544:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 180us (2983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869830.758772:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 128 00000100:00100000:0.0:1788869830.771466:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869830.771549:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869830.771666:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545260672 00000100:00100000:1.0:1788869830.771677:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545260672 00000100:00100000:1.0:1788869830.771724:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545260928 00000100:00100000:1.0:1788869830.771727:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545260928 00000100:00100000:1.0:1788869830.771759:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:1.0:1788869830.771767:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2386:x1875765545260672:12345-192.168.201.30@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788869830.771794:0:17161:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 3b8a01ec-b40e-4f9d-b781-eccdb8771521@192.168.201.30@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:1.0:1788869830.771843:0:17161:0:(genops.c:1406:class_connect()) connect: client 3b8a01ec-b40e-4f9d-b781-eccdb8771521, cookie 0xbead52e175fc4238 00000004:00100000:1.0:1788869830.771868:0:17161:0:(mdt_handler.c:7362:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788869830.772073:0:17161:0:(import.c:65:import_set_state_nolock()) ffff99ffc10de000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869830.772142:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:2386:x1875765545260672:12345-192.168.201.30@tcp:38:mount.lustre.0 Request processed in 373us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869830.772150:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:1.0:1788869830.772168:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:1.0:1788869830.772172:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2386:x1875765545260928:12345-192.168.201.30@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788869830.772186:0:17161:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 3b8a01ec-b40e-4f9d-b781-eccdb8771521@192.168.201.30@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:1.0:1788869830.772217:0:17161:0:(genops.c:1406:class_connect()) connect: client 3b8a01ec-b40e-4f9d-b781-eccdb8771521, cookie 0xbead52e175fc423f 00000004:00100000:1.0:1788869830.772230:0:17161:0:(mdt_handler.c:7362:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788869830.772382:0:17161:0:(import.c:65:import_set_state_nolock()) ffff99ffc10dd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869830.772408:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:2386:x1875765545260928:12345-192.168.201.30@tcp:38:mount.lustre.0 Request processed in 234us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869830.772415:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:0.0:1788869830.791408:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869830.791616:0:19497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545260800 00000100:00100000:3.0:1788869830.791626:0:19497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545260800 00000100:00100000:3.0:1788869830.791705:0:19497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:3.0:1788869830.791716:0:19497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:0:x1875765545260800:12345-192.168.201.30@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788869830.791754:0:19497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788869830.791833:0:19497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:0:x1875765545260800:12345-192.168.201.30@tcp:41:mount.lustre.0 Request processed in 118us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869830.791840:0:19497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00080000:2.0:1788869830.792137:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869830.792288:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869830.792407:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545261056 00000100:00100000:2.0:1788869830.792411:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545261056 00000100:00100000:2.0:1788869830.792462:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:2.0:1788869830.792470:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:0:x1875765545261056:12345-192.168.201.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788869830.792488:0:17160:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788869830.792531:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:0:x1875765545261056:12345-192.168.201.30@tcp:41:mount.lustre.0 Request processed in 62us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869830.792547:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00080000:3.0:1788869830.793356:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869830.802164:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869830.802283:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545261184 00000100:00100000:2.0:1788869830.802294:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545261184 00000100:00100000:2.0:1788869830.802357:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:2.0:1788869830.802368:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:14893:x1875765545261184:12345-192.168.201.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788869830.802401:0:17162:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788869830.802486:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:14893:x1875765545261184:12345-192.168.201.30@tcp:41:mount.lustre.0 Request processed in 120us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869830.802494:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1788869830.806753:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869830.806959:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545261312 00000100:00100000:2.0:1788869830.806969:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545261312 00000100:00100000:2.0:1788869830.807032:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:2.0:1788869830.807042:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:14893:x1875765545261312:12345-192.168.201.30@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788869830.807132:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:14893:x1875765545261312:12345-192.168.201.30@tcp:40:mount.lustre.0 Request processed in 91us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869830.807142:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1788869830.810884:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869830.810932:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869830.810966:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869830.811057:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545261696 00000100:00100000:1.0:1788869830.811067:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545261696 00000100:00100000:1.0:1788869830.811131:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:1.0:1788869830.811141:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:14893:x1875765545261696:12345-192.168.201.30@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788869830.811224:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:14893:x1875765545261696:12345-192.168.201.30@tcp:900:mount.lustre.0 Request processed in 84us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869830.811232:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:2.0:1788869830.811473:0:19702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545261440 00000100:00100000:2.0:1788869830.811478:0:19702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545261440 00000100:00100000:2.0:1788869830.811508:0:19702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545261568 00000100:00100000:2.0:1788869830.811511:0:19702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545261568 00000100:00100000:2.0:1788869830.811526:0:19702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:2.0:1788869830.811531:0:19702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2386:x1875765545261440:12345-192.168.201.30@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788869830.811575:0:19702:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 3b8a01ec-b40e-4f9d-b781-eccdb8771521@192.168.201.30@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:2.0:1788869830.811621:0:19702:0:(genops.c:1406:class_connect()) connect: client 3b8a01ec-b40e-4f9d-b781-eccdb8771521, cookie 0xbead52e175fc4246 00002000:00100000:2.0:1788869830.811632:0:19702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3b8a01ec-b40e-4f9d-b781-eccdb8771521/ffff99fe8310c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788869830.811656:0:19702:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788869830.811810:0:19702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788869830.811836:0:19702:0:(import.c:65:import_set_state_nolock()) ffff99fe8310e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869830.811875:0:19702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:2386:x1875765545261440:12345-192.168.201.30@tcp:8:mount.lustre.0 Request processed in 342us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869830.811882:0:19702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:2.0:1788869830.811896:0:19702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:2.0:1788869830.811901:0:19702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2386:x1875765545261568:12345-192.168.201.30@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788869830.811916:0:19702:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 3b8a01ec-b40e-4f9d-b781-eccdb8771521@192.168.201.30@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:2.0:1788869830.811932:0:19702:0:(genops.c:1406:class_connect()) connect: client 3b8a01ec-b40e-4f9d-b781-eccdb8771521, cookie 0xbead52e175fc424d 00002000:00100000:2.0:1788869830.811937:0:19702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3b8a01ec-b40e-4f9d-b781-eccdb8771521/ffff99fe8310d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788869830.811947:0:19702:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788869830.812038:0:19702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788869830.812052:0:19702:0:(import.c:65:import_set_state_nolock()) ffff99fe83108000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869830.812076:0:19702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:2386:x1875765545261568:12345-192.168.201.30@tcp:8:mount.lustre.0 Request processed in 173us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869830.812083:0:19702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:0.0:1788869830.818805:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869830.818918:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545261824 00000100:00100000:3.0:1788869830.818928:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545261824 00000100:00100000:3.0:1788869830.818982:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:3.0:1788869830.818993:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:14893:x1875765545261824:12345-192.168.201.30@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788869830.831488:0:17163:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 12401us 00000004:00200000:3.0:1788869830.840397:0:17163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788869830.840536:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:14893:x1875765545261824:12345-192.168.201.30@tcp:33:mount.lustre.0 Request processed in 21539us (21738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869830.840547:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:1.0:1788869831.064713:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554775680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869831.064791:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869831.065063:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554775936:0@lo:400:kworker.0 00000100:00100000:2.0:1788869831.065094:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869831.065116:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554776448:0@lo:400:kworker.0 00000100:00100000:2.0:1788869831.065139:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869831.065153:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554776960:0@lo:400:kworker.0 00000100:00100000:2.0:1788869831.065178:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869831.065193:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788869831.065215:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3617:1875765554775808:0@lo:400:kworker.0 00000100:00100000:2.0:1788869831.065240:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869831.065275:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554776320:0@lo:400:kworker.0 00000100:00100000:2.0:1788869831.065296:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869831.065312:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875765554776832:0@lo:400:kworker.0 00000100:00100000:2.0:1788869831.065344:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869831.065493:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554776064:0@lo:400:kworker.0 00000100:00100000:2.0:1788869831.065519:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869831.065537:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554776576:0@lo:400:kworker.0 00000100:00100000:2.0:1788869831.065557:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869831.065571:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554777088:0@lo:400:kworker.0 00000100:00100000:1.0:1788869831.065747:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554775808 00000100:00100000:1.0:1788869831.065754:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554775808 00000100:00100000:1.0:1788869831.065793:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788869831.065801:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:3617:x1875765554775808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869831.065845:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:3617:x1875765554775808:12345-0@lo:400:kworker.0 Request processed in 44us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869831.065852:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788869831.065903:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554775936 00000100:00100000:1.0:1788869831.065907:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554775936 00000100:00100000:1.0:1788869831.065931:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554776320 00000100:00100000:1.0:1788869831.065934:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554776320 00000100:00100000:1.0:1788869831.065946:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788869831.065951:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554775936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869831.065982:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554775936:12345-0@lo:400:kworker.0 Request processed in 31us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869831.065987:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788869831.065996:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788869831.066000:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554776320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869831.066020:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554776320:12345-0@lo:400:kworker.0 Request processed in 20us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869831.066025:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788869831.066044:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554776192:0@lo:400:kworker.0 00000100:00100000:1.0:1788869831.066065:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869831.066080:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875765554776704:0@lo:400:kworker.0 00000100:00100000:1.0:1788869831.066108:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869831.066124:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554777216:0@lo:400:kworker.0 00000100:00100000:1.0:1788869831.066146:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869831.066172:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554776960 00000100:00100000:1.0:1788869831.066176:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554776960 00000100:00100000:1.0:1788869831.066201:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554776832 00000100:00100000:1.0:1788869831.066203:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554776832 00000100:00100000:1.0:1788869831.066215:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554776192 00000100:00100000:1.0:1788869831.066217:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554776192 00000100:00100000:1.0:1788869831.066226:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554776704 00000100:00100000:1.0:1788869831.066229:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554776704 00000100:00100000:1.0:1788869831.066238:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554777216 00000100:00100000:1.0:1788869831.066239:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554777216 00000100:00100000:1.0:1788869831.066276:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788869831.066282:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554776960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869831.066312:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875765554776960:12345-0@lo:400:kworker.0 Request processed in 31us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869831.066318:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788869831.066343:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788869831.066349:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875765554776832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869831.066474:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869831.066511:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3617:1875765554775808:0@lo:400:kworker.0 00000100:00100000:2.0:1788869831.066524:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554776320:0@lo:400:kworker.0 00000100:00100000:2.0:1788869831.066534:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554775936:0@lo:400:kworker.0 00010000:00080000:2.0:1788869831.066545:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8397e300 x1875765554776960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869831.066554:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875765554776960:0@lo:400:kworker.0 00000100:00100000:2.0:1788869831.066572:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869831.066980:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554775680 00000100:00100000:3.0:1788869831.066985:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554775680 00000100:00100000:3.0:1788869831.067024:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788869831.067031:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554775680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788869831.067048:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788869831.067091:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554775680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (2301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869831.067097:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788869831.067117:0:19498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554777088 00000100:00100000:3.0:1788869831.067120:0:19498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554777088 00000100:00100000:3.0:1788869831.067137:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788869831.067143:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554776192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869831.067172:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554776192:12345-0@lo:400:kworker.0 Request processed in 30us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869831.067178:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788869831.067189:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788869831.067204:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875765554776704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869831.067229:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875765554776704:12345-0@lo:400:kworker.0 Request processed in 26us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869831.067234:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788869831.067245:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788869831.067270:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875765554777216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869831.067296:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875765554777216:12345-0@lo:400:kworker.0 Request processed in 46us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869831.067302:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788869831.067315:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788869831.067333:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554777088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869831.067485:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875765554777088:12345-0@lo:400:kworker.0 Request processed in 165us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869831.067492:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788869831.067513:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869831.067518:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869831.067520:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788869831.067548:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8397dc00 x1875765554776192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869831.067561:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554776192:0@lo:400:kworker.0 00010000:00080000:3.0:1788869831.067572:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8397f800 x1875765554776704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869831.067745:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554777344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869831.067781:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869831.067812:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554777344 00000100:00100000:2.0:1788869831.067816:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554777344 00000100:00100000:2.0:1788869831.067850:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869831.067855:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554777344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869831.067864:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788869831.067888:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554777344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869831.067895:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788869831.067924:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8397ea00 x1875765554777088/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869831.067933:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875765554777088:0@lo:400:kworker.0 00000100:00100000:2.0:1788869831.067955:0:19702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554776448 00000100:00100000:2.0:1788869831.067959:0:19702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554776448 00000100:00100000:2.0:1788869831.067985:0:19702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554776064 00000100:00100000:2.0:1788869831.067989:0:19702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554776064 00000100:00100000:2.0:1788869831.068004:0:19702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554776576 00000100:00100000:2.0:1788869831.068006:0:19702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554776576 00000100:00100000:2.0:1788869831.068020:0:19702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869831.068025:0:19702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554776448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869831.068054:0:19702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554776448:12345-0@lo:400:kworker.0 Request processed in 29us (2914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869831.068060:0:19702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869831.068070:0:19702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788869831.068075:0:19702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554776064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869831.068114:0:19702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554776064:12345-0@lo:400:kworker.0 Request processed in 39us (2594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869831.068119:0:19702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788869831.068129:0:19702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869831.068135:0:19702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3618:x1875765554776576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869831.068168:0:19702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3618:x1875765554776576:12345-0@lo:400:kworker.0 Request processed in 34us (2611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869831.068174:0:19702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869831.068201:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554776064:0@lo:400:kworker.0 00000100:00100000:2.0:1788869831.068212:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554776576:0@lo:400:kworker.0 00000100:00100000:2.0:1788869831.068238:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554777344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869831.068248:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554776448:0@lo:400:kworker.0 00000100:00080000:2.0:1788869831.068303:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788869831.068307:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869831.068525:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875765554776832:12345-0@lo:400:kworker.0 Request processed in 2176us (3180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869831.068531:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788869831.068696:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875765554776704:0@lo:400:kworker.0 00010000:00080000:3.0:1788869831.068709:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8397ca80 x1875765554777216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869831.068724:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554777216:0@lo:400:kworker.0 00000100:00100000:3.0:1788869831.068736:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554775680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869831.069313:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869831.069322:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8335c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554777472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869831.069357:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869831.069888:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554777472 00000100:00100000:1.0:1788869831.069896:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554777472 00000100:00100000:1.0:1788869831.069977:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788869831.069978:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8397c380 x1875765554776832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869831.069985:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1875765554777472:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869831.069990:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875765554776832:0@lo:400:kworker.0 00002000:00000024:1.0:1788869831.070005:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788869831.070076:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1875765554777472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869831.070083:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869831.070151:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8335c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554777472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869831.070988:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869831.071054:0:19498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545261952 00000100:00100000:3.0:1788869831.071060:0:19498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545261952 00000100:00100000:3.0:1788869831.071110:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:3.0:1788869831.071118:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:14940:x1875765545261952:12345-192.168.201.30@tcp:101:mkdir.0 00010000:00010000:3.0:1788869831.071135:0:19498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869831.071164:0:19498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc4254 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaae3d expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869831.071230:0:19498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535800/0xbead52e175fc425b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869831.071245:0:19498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535800/0xbead52e175fc425b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869831.071279:0:19498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535800/0xbead52e175fc425b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869831.071336:0:19498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788869831.071339:0:19498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869831.071381:0:19498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535800/0xbead52e175fc425b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869831.071407:0:19498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534600/0xbead52e175fc4254 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae3d expref: 8 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869831.071436:0:19498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535800/0xbead52e175fc425b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae3d expref: 7 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869831.071456:0:19498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff8990da00) 00010000:00010000:3.0:1788869831.071459:0:19498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869831.071463:0:19498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81535800, rc 0) 00000100:00100000:3.0:1788869831.071517:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+7:14940:x1875765545261952:12345-192.168.201.30@tcp:101:mkdir.0 Request processed in 399us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869831.071524:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00010000:00010000:2.0:1788869831.512487:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788869832.090612:0:19482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3b8a01ec-b40e-4f9d-b781-eccdb8771521 00000001:00080000:0.0:1788869832.090630:0:19482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:3.0:1788869832.536688:0:19700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788869832.920976:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788869833.079177:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869833.079286:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545262080 00000100:00100000:2.0:1788869833.079297:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545262080 00000100:00100000:2.0:1788869833.079395:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:2.0:1788869833.079406:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+7:14993:x1875765545262080:12345-192.168.201.30@tcp:41:lfs.0 00000004:00000024:2.0:1788869833.079446:0:17160:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788869833.079538:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+7:14993:x1875765545262080:12345-192.168.201.30@tcp:41:lfs.0 Request processed in 132us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869833.079546:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00080000:3.0:1788869833.079624:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869833.083981:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869833.084904:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545262208 00000100:00100000:1.0:1788869833.084916:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545262208 00000100:00100000:1.0:1788869833.085021:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:1.0:1788869833.085032:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:14993:x1875765545262208:12345-192.168.201.30@tcp:41:lfs.0 00000004:00000024:1.0:1788869833.085075:0:17162:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788869833.085172:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:14993:x1875765545262208:12345-192.168.201.30@tcp:41:lfs.0 Request processed in 141us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869833.085181:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00080000:3.0:1788869833.085298:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869833.093878:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869833.094018:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545262336 00000100:00100000:2.0:1788869833.094030:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545262336 00000100:00100000:2.0:1788869833.094152:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:2.0:1788869833.094164:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:14993:x1875765545262336:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:2.0:1788869833.094200:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788869833.094336:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:14993:x1875765545262336:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 173us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869833.094344:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00080000:3.0:1788869833.095299:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869833.098475:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869833.098709:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545262464 00000100:00100000:2.0:1788869833.098720:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545262464 00000100:00100000:2.0:1788869833.098807:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:2.0:1788869833.098819:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3b8a01ec-b40e-4f9d-b781-eccdb8771521+5:14993:x1875765545262464:12345-192.168.201.30@tcp:13:lfs.0 00000100:00080000:3.0:1788869833.098867:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1788869833.098867:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788869833.098955:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3b8a01ec-b40e-4f9d-b781-eccdb8771521+5:14993:x1875765545262464:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 137us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869833.098963:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000001:00100000:3.0:1788869833.116386:0:18663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3b8a01ec-b40e-4f9d-b781-eccdb8771521 00000100:00100000:0.0:1788869833.279522:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869833.279634:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545262592 00000100:00100000:2.0:1788869833.279644:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545262592 00000100:00100000:2.0:1788869833.279702:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 130 00000100:00100000:2.0:1788869833.279713:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+10:15025:x1875765545262592:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788869833.279730:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869833.279751:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fe823c1c00/0xbead52e175fc4262 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaae44 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869833.279777:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fe823c1c00/0xbead52e175fc4262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae44 expref: 11 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869833.279807:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fe823c1c00/0xbead52e175fc4262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae44 expref: 11 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869833.279818:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1c00, rc 0) 00000100:00100000:2.0:1788869833.279876:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+11:15025:x1875765545262592:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 166us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869833.279883:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 130 00000100:00100000:0.0:1788869833.300534:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869833.300683:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545262720 00000100:00100000:2.0:1788869833.300694:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545262720 00000100:00100000:2.0:1788869833.300767:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 131 00000100:00100000:2.0:1788869833.300778:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10bffde-eac0-4cc8-9215-f0ed84a241b8+11:15025:x1875765545262720:12345-192.168.201.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788869833.300960:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10bffde-eac0-4cc8-9215-f0ed84a241b8+11:15025:x1875765545262720:12345-192.168.201.30@tcp:501:mount.lustre.0 Request processed in 182us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869833.300969:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 131 00000100:00100000:0.0:1788869833.312584:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869833.320568:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545262848 00000100:00100000:1.0:1788869833.320585:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545262848 00000100:00100000:1.0:1788869833.320664:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 132 00000100:00100000:1.0:1788869833.320675:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+11:15025:x1875765545262848:12345-192.168.201.30@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788869833.320862:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+11:15025:x1875765545262848:12345-192.168.201.30@tcp:503:mount.lustre.0 Request processed in 188us (8289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869833.321663:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 132 00000100:00100000:1.0:1788869833.332021:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869833.332798:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545262976 00000100:00100000:0.0:1788869833.332811:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545262976 00000100:00100000:0.0:1788869833.332895:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 133 00000100:00100000:0.0:1788869833.332907:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+11:15032:x1875765545262976:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788869833.333084:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+11:15032:x1875765545262976:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 179us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869833.333093:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 133 00000100:00100000:0.0:1788869833.363452:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869833.363628:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545263104 00000100:00100000:2.0:1788869833.363641:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545263104 00000100:00100000:2.0:1788869833.363704:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 134 00000100:00100000:2.0:1788869833.363717:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10bffde-eac0-4cc8-9215-f0ed84a241b8+11:15032:x1875765545263104:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869833.363923:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10bffde-eac0-4cc8-9215-f0ed84a241b8+11:15032:x1875765545263104:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 208us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869833.363932:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 134 00000100:00100000:1.0:1788869833.369195:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869833.369539:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545263232 00000100:00100000:2.0:1788869833.369555:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545263232 00000100:00100000:2.0:1788869833.369633:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 135 00000100:00100000:2.0:1788869833.369644:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+11:15032:x1875765545263232:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869833.369829:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+11:15032:x1875765545263232:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 187us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869833.369837:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 135 00000100:00100000:3.0:1788869833.378013:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869833.378241:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545263360 00000100:00100000:0.0:1788869833.378539:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545263360 00000100:00100000:0.0:1788869833.379148:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 136 00000100:00100000:0.0:1788869833.379161:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+11:15025:x1875765545263360:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788869833.379178:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869833.379199:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffbfb04400/0xbead52e175fc4269 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaae75 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869833.379232:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffbfb04400/0xbead52e175fc4269 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae75 expref: 12 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869833.379243:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffbfb04400/0xbead52e175fc4269 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae75 expref: 12 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869833.379273:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04400, rc 0) 00000100:00100000:0.0:1788869833.379394:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+12:15025:x1875765545263360:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 235us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869833.379402:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 136 00000100:00100000:1.0:1788869833.387400:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869833.387564:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545263488 00000100:00100000:0.0:1788869833.387575:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545263488 00000100:00100000:0.0:1788869833.387762:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 137 00000100:00100000:0.0:1788869833.387773:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83940450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10bffde-eac0-4cc8-9215-f0ed84a241b8+12:15025:x1875765545263488:12345-192.168.201.30@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788869833.387816:0:17155:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788869833.387832:0:17155:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788869833.387836:0:17155:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788869833.387839:0:17155:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788869833.387842:0:17155:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788869833.387844:0:17155:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788869833.390387:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83940450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10bffde-eac0-4cc8-9215-f0ed84a241b8+12:15025:x1875765545263488:12345-192.168.201.30@tcp:256:mount.lustre.0 Request processed in 2593us (2989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869833.390403:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 137 00000100:00100000:3.0:1788869833.393156:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869833.405417:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545263616 00000100:00100000:2.0:1788869833.405434:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545263616 00000100:00100000:2.0:1788869833.405507:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 138 00000100:00100000:2.0:1788869833.405520:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+12:15025:x1875765545263616:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788869833.405538:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869833.405561:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fe823c1800/0xbead52e175fc4270 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaae7c expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869833.405592:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fe823c1800/0xbead52e175fc4270 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae7c expref: 13 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869833.405614:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fe823c1800/0xbead52e175fc4270 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae7c expref: 13 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869833.405622:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1800, rc 0) 00000100:00100000:2.0:1788869833.405697:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:15025:x1875765545263616:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 179us (12558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869833.405705:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 138 00000100:00100000:3.0:1788869833.408031:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869833.408166:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545263744 00000100:00100000:2.0:1788869833.408193:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545263744 00000100:00100000:2.0:1788869833.408310:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 139 00000100:00100000:2.0:1788869833.408324:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83942c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:15025:x1875765545263744:12345-192.168.201.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788869833.408556:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83942c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:15025:x1875765545263744:12345-192.168.201.30@tcp:501:mount.lustre.0 Request processed in 235us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869833.408587:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 139 00000100:00100000:3.0:1788869833.411092:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869833.411314:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545263872 00000100:00100000:2.0:1788869833.411328:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545263872 00000100:00100000:3.0:1788869833.411606:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 140 00000100:00100000:3.0:1788869833.411620:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:15025:x1875765545263872:12345-192.168.201.30@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788869833.411836:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:15025:x1875765545263872:12345-192.168.201.30@tcp:503:mount.lustre.0 Request processed in 219us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869833.411846:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 140 00000100:00100000:3.0:1788869833.414959:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869833.415413:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545264000 00000100:00100000:1.0:1788869833.415427:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545264000 00000100:00100000:1.0:1788869833.415504:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 141 00000100:00100000:1.0:1788869833.415516:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:15037:x1875765545264000:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788869833.415729:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:15037:x1875765545264000:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 214us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869833.415738:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 141 00000100:00100000:2.0:1788869833.439337:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869833.439596:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545264128 00000100:00100000:1.0:1788869833.439612:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545264128 00000100:00100000:1.0:1788869833.439700:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 142 00000100:00100000:1.0:1788869833.439713:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83941850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:15037:x1875765545264128:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788869833.439961:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83941850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:15037:x1875765545264128:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 249us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869833.439971:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 142 00000100:00100000:3.0:1788869833.457433:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869833.457551:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869833.457661:0:19497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545264256 00000100:00100000:0.0:1788869833.457675:0:19497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545264256 00000100:00100000:0.0:1788869833.457731:0:19497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545264512 00000100:00100000:0.0:1788869833.457734:0:19497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545264512 00000100:00100000:0.0:1788869833.457762:0:19497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:0.0:1788869833.457775:0:19497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2386:x1875765545264256:12345-192.168.201.30@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788869833.457818:0:19497:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 31cd0bfc-dd3a-4c19-9441-01049d848740@192.168.201.30@tcp t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:0.0:1788869833.457872:0:19497:0:(genops.c:1406:class_connect()) connect: client 31cd0bfc-dd3a-4c19-9441-01049d848740, cookie 0xbead52e175fc4277 00000004:00100000:0.0:1788869833.457906:0:19497:0:(mdt_handler.c:7362:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788869833.458043:0:19497:0:(import.c:65:import_set_state_nolock()) ffff99fe8109c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869833.458140:0:19497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31cd0bfc-dd3a-4c19-9441-01049d848740+6:2386:x1875765545264256:12345-192.168.201.30@tcp:38:mount.lustre.0 Request processed in 365us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869833.458149:0:19497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:0.0:1788869833.458169:0:19497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:0.0:1788869833.458175:0:19497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2386:x1875765545264512:12345-192.168.201.30@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788869833.458191:0:19497:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 31cd0bfc-dd3a-4c19-9441-01049d848740@192.168.201.30@tcp t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:0.0:1788869833.458216:0:19497:0:(genops.c:1406:class_connect()) connect: client 31cd0bfc-dd3a-4c19-9441-01049d848740, cookie 0xbead52e175fc427e 00000004:00100000:0.0:1788869833.458247:0:19497:0:(mdt_handler.c:7362:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788869833.458348:0:19497:0:(import.c:65:import_set_state_nolock()) ffff99fe8109d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869833.458389:0:19497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31cd0bfc-dd3a-4c19-9441-01049d848740+6:2386:x1875765545264512:12345-192.168.201.30@tcp:38:mount.lustre.0 Request processed in 212us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869833.458396:0:19497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:0.0:1788869833.466804:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869833.466852:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869833.466888:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869833.466993:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545264768 00000100:00100000:1.0:1788869833.467008:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545264768 00000100:00100000:1.0:1788869833.467101:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545264640 00000100:00100000:1.0:1788869833.467105:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545264640 00000100:00100000:1.0:1788869833.467127:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545264384 00000100:00100000:1.0:1788869833.467130:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545264384 00000100:00100000:1.0:1788869833.467148:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:1.0:1788869833.467159:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31cd0bfc-dd3a-4c19-9441-01049d848740+7:15025:x1875765545264768:12345-192.168.201.30@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788869833.467219:0:17162:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788869833.467355:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31cd0bfc-dd3a-4c19-9441-01049d848740+7:15025:x1875765545264768:12345-192.168.201.30@tcp:41:mount.lustre.0 Request processed in 197us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869833.467364:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:1.0:1788869833.467393:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:1.0:1788869833.467400:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31cd0bfc-dd3a-4c19-9441-01049d848740+6:0:x1875765545264640:12345-192.168.201.30@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788869833.467413:0:17162:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788869833.467463:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31cd0bfc-dd3a-4c19-9441-01049d848740+6:0:x1875765545264640:12345-192.168.201.30@tcp:41:mount.lustre.0 Request processed in 62us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869833.467470:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:1.0:1788869833.467483:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:1.0:1788869833.467489:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31cd0bfc-dd3a-4c19-9441-01049d848740+6:0:x1875765545264384:12345-192.168.201.30@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788869833.467499:0:17162:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788869833.467520:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31cd0bfc-dd3a-4c19-9441-01049d848740+6:0:x1875765545264384:12345-192.168.201.30@tcp:41:mount.lustre.0 Request processed in 31us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869833.467526:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00080000:0.0:1788869833.468168:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869833.468184:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869833.471200:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869833.471565:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545264896 00000100:00100000:1.0:1788869833.471644:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545264896 00000100:00100000:1.0:1788869833.471725:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:1.0:1788869833.471737:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31cd0bfc-dd3a-4c19-9441-01049d848740+6:15025:x1875765545264896:12345-192.168.201.30@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788869833.471857:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31cd0bfc-dd3a-4c19-9441-01049d848740+6:15025:x1875765545264896:12345-192.168.201.30@tcp:40:mount.lustre.0 Request processed in 122us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869833.471866:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:1.0:1788869833.476566:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869833.477983:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869833.478046:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869833.478232:0:19702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545265024 00000100:00100000:2.0:1788869833.478245:0:19702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545265024 00000100:00100000:2.0:1788869833.478318:0:19702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545265152 00000100:00100000:2.0:1788869833.478322:0:19702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545265152 00000100:00100000:2.0:1788869833.478359:0:19702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:2.0:1788869833.478369:0:19702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2386:x1875765545265024:12345-192.168.201.30@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788869833.478423:0:19702:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 31cd0bfc-dd3a-4c19-9441-01049d848740@192.168.201.30@tcp t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:2.0:1788869833.478466:0:19702:0:(genops.c:1406:class_connect()) connect: client 31cd0bfc-dd3a-4c19-9441-01049d848740, cookie 0xbead52e175fc4285 00002000:00100000:2.0:1788869833.478482:0:19702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 31cd0bfc-dd3a-4c19-9441-01049d848740/ffff99fe8310a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788869833.478499:0:19702:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788869833.478795:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:3.0:1788869833.478816:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2386:x1875765545265152:12345-192.168.201.30@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788869833.478838:0:18669:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 31cd0bfc-dd3a-4c19-9441-01049d848740@192.168.201.30@tcp t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:3.0:1788869833.478876:0:18669:0:(genops.c:1406:class_connect()) connect: client 31cd0bfc-dd3a-4c19-9441-01049d848740, cookie 0xbead52e175fc428c 00002000:00100000:3.0:1788869833.478882:0:18669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 31cd0bfc-dd3a-4c19-9441-01049d848740/ffff99ffa5d7e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113718 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788869833.478890:0:18669:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788869833.478969:0:18669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788869833.479010:0:18669:0:(import.c:65:import_set_state_nolock()) ffff99ffa5d7d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869833.479105:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31cd0bfc-dd3a-4c19-9441-01049d848740+6:2386:x1875765545265152:12345-192.168.201.30@tcp:8:mount.lustre.0 Request processed in 288us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869833.479113:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:0.0:1788869833.479720:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545265280 00000100:00100000:0.0:1788869833.479729:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545265280 00000100:00100000:0.0:1788869833.479792:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:0.0:1788869833.479802:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:31cd0bfc-dd3a-4c19-9441-01049d848740+6:15025:x1875765545265280:12345-192.168.201.30@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788869833.479868:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:31cd0bfc-dd3a-4c19-9441-01049d848740+6:15025:x1875765545265280:12345-192.168.201.30@tcp:900:mount.lustre.0 Request processed in 68us (3320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869833.479875:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00002000:00080000:2.0:1788869833.480809:0:19702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788869833.480853:0:19702:0:(import.c:65:import_set_state_nolock()) ffff99ff8554f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869833.480911:0:19702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31cd0bfc-dd3a-4c19-9441-01049d848740+6:2386:x1875765545265024:12345-192.168.201.30@tcp:8:mount.lustre.0 Request processed in 2541us (2938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869833.480919:0:19702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:0.0:1788869833.485949:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869833.486089:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545265408 00000100:00100000:3.0:1788869833.486104:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545265408 00000100:00100000:3.0:1788869833.486164:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:3.0:1788869833.486182:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31cd0bfc-dd3a-4c19-9441-01049d848740+6:15025:x1875765545265408:12345-192.168.201.30@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788869833.486328:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788869833.486449:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31cd0bfc-dd3a-4c19-9441-01049d848740+6:15025:x1875765545265408:12345-192.168.201.30@tcp:33:mount.lustre.0 Request processed in 267us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869833.486458:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00010000:00010000:2.0:1788869833.560730:0:19701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869833.624899:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554777600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869833.625014:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869833.625217:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554777600 00000100:00100000:0.0:1788869833.625228:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554777600 00000100:00100000:0.0:1788869833.625342:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788869833.625375:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554777600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788869833.625408:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1788869833.625556:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869833.625617:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554777600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 254us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869833.625627:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788869833.625833:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554777600:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869833.638943:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869833.639314:0:19498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545265536 00000100:00100000:1.0:1788869833.639326:0:19498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545265536 00000100:00100000:1.0:1788869833.639413:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:1.0:1788869833.639426:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31cd0bfc-dd3a-4c19-9441-01049d848740+6:15060:x1875765545265536:12345-192.168.201.30@tcp:101:mkdir.0 00010000:00010000:1.0:1788869833.639456:0:19498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869833.639488:0:19498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9c00/0xbead52e175fc4293 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaead expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869833.639592:0:19498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc429a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869833.639610:0:19498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc429a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869833.639624:0:19498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc429a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869833.639689:0:19498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788869833.639694:0:19498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869833.639721:0:19498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc429a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869833.639752:0:19498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9c00/0xbead52e175fc4293 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaead expref: 8 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869833.639770:0:19498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc429a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaead expref: 7 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869833.639778:0:19498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff8990da00) 00010000:00010000:1.0:1788869833.639780:0:19498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869833.639783:0:19498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a9200, rc 0) 00000100:00100000:1.0:1788869833.639863:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31cd0bfc-dd3a-4c19-9441-01049d848740+7:15060:x1875765545265536:12345-192.168.201.30@tcp:101:mkdir.0 Request processed in 439us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869833.639871:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00010000:00010000:2.0:1788869834.584541:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869834.648569:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869834.648593:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554777728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869834.648676:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869834.648740:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554777728 00000100:00100000:1.0:1788869834.648749:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554777728 00000100:00100000:1.0:1788869834.648809:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788869834.648819:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554777728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788869834.648856:0:17165:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788869834.648901:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554777728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869834.648909:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788869834.648959:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554777728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869834.649542:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554777856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869834.649577:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869834.649650:0:17901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554777856 00000100:00100000:0.0:1788869834.649656:0:17901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554777856 00000100:00100000:0.0:1788869834.649687:0:17901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788869834.649694:0:17901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554777856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788869834.649716:0:17901:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788869834.649764:0:17901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554777856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869834.649771:0:17901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788869834.649796:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554777856:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788869835.608794:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869835.865160:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788869836.184476:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfa49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554777984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869836.184555:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869836.184779:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554778112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869836.184809:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869836.184881:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554777984 00000100:00100000:0.0:1788869836.184888:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554777984 00000100:00100000:0.0:1788869836.184953:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554778112 00000100:00100000:0.0:1788869836.184957:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554778112 00000100:00100000:0.0:1788869836.184978:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788869836.184988:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554777984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869836.185034:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788869836.185084:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554777984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869836.185092:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788869836.185109:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788869836.185115:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554778112:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788869836.185351:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869836.185391:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfa49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554777984:0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869836.185466:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788869836.185497:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554778112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 382us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869836.185504:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788869836.185563:0:3618:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788869836.185580:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554778112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869836.186636:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3619:1875765554778240:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.186694:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869836.186727:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554778752:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.186755:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869836.186775:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554779264:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.186798:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869836.186821:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788869836.186826:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554778624:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.186846:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869836.186864:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554779136:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.186882:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869836.186908:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554778240 00000100:00100000:2.0:1788869836.186914:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554778240 00000100:00100000:2.0:1788869836.186964:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788869836.186971:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:3619:x1875765554778240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.187012:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:3619:x1875765554778240:12345-0@lo:400:kworker.0 Request processed in 41us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869836.187019:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788869836.187049:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554778752 00000100:00100000:2.0:1788869836.187052:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554778752 00000100:00100000:2.0:1788869836.187077:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788869836.187083:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554778752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.187115:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554778752:12345-0@lo:400:kworker.0 Request processed in 32us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869836.187128:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788869836.187147:0:19497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554779264 00000100:00100000:2.0:1788869836.187150:0:19497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554779264 00000100:00100000:2.0:1788869836.187178:0:19497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554778624 00000100:00100000:2.0:1788869836.187180:0:19497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554778624 00000100:00100000:2.0:1788869836.187195:0:19497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554779136 00000100:00100000:2.0:1788869836.187197:0:19497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554779136 00000100:00100000:2.0:1788869836.187212:0:19497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788869836.187217:0:19497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875765554779264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.187246:0:19497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875765554779264:12345-0@lo:400:kworker.0 Request processed in 29us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869836.187280:0:19497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788869836.187293:0:19497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788869836.187298:0:19497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554778624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.187340:0:19497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554778624:12345-0@lo:400:kworker.0 Request processed in 42us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869836.187355:0:19497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788869836.187368:0:19497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788869836.187374:0:19497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfa48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554779136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.187403:0:19497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfa48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554779136:12345-0@lo:400:kworker.0 Request processed in 30us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869836.187408:0:19497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788869836.187435:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554778368:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.187461:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869836.187479:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554778880:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.187501:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869836.187517:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875765554779392:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.187537:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869836.187554:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788869836.187560:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554778496:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.187580:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869836.187596:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554779008:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.187614:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869836.187630:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554779520:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.187648:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869836.187669:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554778880 00000100:00100000:2.0:1788869836.187672:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554778880 00000100:00100000:2.0:1788869836.187693:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554778496 00000100:00100000:2.0:1788869836.187695:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554778496 00000100:00100000:2.0:1788869836.187727:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869836.187733:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554778880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.187770:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554778880:12345-0@lo:400:kworker.0 Request processed in 38us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869836.187777:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869836.187787:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869836.187793:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554778496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.187814:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554778496:12345-0@lo:400:kworker.0 Request processed in 22us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869836.187819:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869836.187832:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554779392 00000100:00100000:2.0:1788869836.187834:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554779392 00000100:00100000:2.0:1788869836.187848:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554779008 00000100:00100000:2.0:1788869836.187850:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554779008 00000100:00100000:2.0:1788869836.187858:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554779520 00000100:00100000:2.0:1788869836.187860:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554779520 00000100:00100000:2.0:1788869836.187870:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788869836.187875:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875765554779392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.187900:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875765554779392:12345-0@lo:400:kworker.0 Request processed in 24us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869836.187905:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788869836.187914:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788869836.187919:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554779008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.187940:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875765554779008:12345-0@lo:400:kworker.0 Request processed in 21us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869836.187946:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788869836.187955:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788869836.187960:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554779520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.187992:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875765554779520:12345-0@lo:400:kworker.0 Request processed in 32us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869836.187998:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788869836.188014:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788869836.188018:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869836.188020:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869836.188050:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554778496:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.188060:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875765554779008:0@lo:400:kworker.0 00010000:00080000:2.0:1788869836.188069:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe82228000 x1875765554779520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869836.188078:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875765554779520:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.188086:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554778880:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.188094:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875765554779392:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.188135:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554778624:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.188144:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554779136:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.188152:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3619:1875765554778240:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.188161:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554778752:0@lo:400:kworker.0 00010000:00080000:2.0:1788869836.188169:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe8222ad80 x1875765554779264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869836.188177:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875765554779264:0@lo:400:kworker.0 00000100:00100000:3.0:1788869836.188944:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554778368 00000100:00100000:3.0:1788869836.188951:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554778368 00000100:00100000:3.0:1788869836.189184:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788869836.189195:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554778368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869836.189280:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554778368:12345-0@lo:400:kworker.0 Request processed in 88us (1817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869836.189288:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788869836.190336:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554778368:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.190376:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869836.190387:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554779648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788869836.190430:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869836.190653:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554779648 00000100:00100000:0.0:1788869836.190660:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554779648 00000100:00100000:0.0:1788869836.190707:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788869836.190716:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554779648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869836.190750:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788869836.190796:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554779648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869836.190803:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788869836.190835:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554779648:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788869836.199773:0:17893:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 31cd0bfc-dd3a-4c19-9441-01049d848740 00000001:00100000:2.0:1788869836.199787:0:17893:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3b8a01ec-b40e-4f9d-b781-eccdb8771521 00000001:00100000:2.0:1788869836.207618:0:17140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 31cd0bfc-dd3a-4c19-9441-01049d848740 00000001:00100000:2.0:1788869836.207634:0:17140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3b8a01ec-b40e-4f9d-b781-eccdb8771521 00010000:00010000:0.0:1788869836.632616:0:19700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788869836.643960:0:20042:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788869837.656831:0:19701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869838.685613:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869838.753047:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869838.753218:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554779776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869838.753462:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869838.756545:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554779776 00000100:00100000:3.0:1788869838.756561:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554779776 00000100:00100000:2.0:1788869838.756689:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788869838.756701:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554779776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788869838.756735:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788869838.756813:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554779776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (3352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869838.756821:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788869838.756938:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554779776:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788869838.757053:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869838.963230:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869838.966687:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869838.966724:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869838.966744:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869838.966771:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869838.966790:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869838.966809:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869838.966826:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869838.966851:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869838.966897:0:19702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545266048 00000100:00100000:1.0:1788869838.966907:0:19702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545266048 00000100:00100000:1.0:1788869838.966965:0:19702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545266560 00000100:00100000:1.0:1788869838.966969:0:19702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545266560 00000100:00100000:1.0:1788869838.966983:0:19702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545266176 00000100:00100000:1.0:1788869838.966985:0:19702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545266176 00000100:00100000:1.0:1788869838.966996:0:19702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545266688 00000100:00100000:1.0:1788869838.966999:0:19702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545266688 00000100:00100000:1.0:1788869838.967013:0:19702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:1.0:1788869838.967023:0:19702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+5:2388:x1875765545266048:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869838.967104:0:19702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+5:2388:x1875765545266048:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 82us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869838.967112:0:19702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:1.0:1788869838.967129:0:19702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:1.0:1788869838.967135:0:19702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31cd0bfc-dd3a-4c19-9441-01049d848740+6:2388:x1875765545266560:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869838.967158:0:19702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31cd0bfc-dd3a-4c19-9441-01049d848740+6:2388:x1875765545266560:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869838.967163:0:19702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:1.0:1788869838.967172:0:19702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:1.0:1788869838.967178:0:19702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+5:2388:x1875765545266176:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869838.967199:0:19702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+5:2388:x1875765545266176:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869838.967204:0:19702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:1.0:1788869838.967215:0:19702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:1.0:1788869838.967221:0:19702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31cd0bfc-dd3a-4c19-9441-01049d848740+6:2388:x1875765545266688:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1788869838.967241:0:19702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:31cd0bfc-dd3a-4c19-9441-01049d848740+6:2388:x1875765545266688:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 20us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869838.967361:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545265664 00000100:00100000:3.0:1788869838.967366:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545265664 00000100:00100000:3.0:1788869838.967398:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 144 00000100:00100000:3.0:1788869838.967405:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:2388:x1875765545265664:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869838.967430:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:2388:x1875765545265664:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869838.967436:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 144 00000100:00100000:3.0:1788869838.967470:0:19498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545265792 00000100:00100000:3.0:1788869838.967474:0:19498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545265792 00000100:00100000:3.0:1788869838.967545:0:19498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545266304 00000100:00100000:3.0:1788869838.967549:0:19498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545266304 00000100:00100000:3.0:1788869838.967563:0:19498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545265920 00000100:00100000:3.0:1788869838.967566:0:19498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545265920 00000100:00100000:3.0:1788869838.967577:0:19498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545266432 00000100:00100000:3.0:1788869838.967580:0:19498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545266432 00000100:00100000:3.0:1788869838.967593:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:3.0:1788869838.967599:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:2388:x1875765545265792:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869838.967627:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:2388:x1875765545265792:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (4408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869838.967633:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:3.0:1788869838.967644:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:3.0:1788869838.967650:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31cd0bfc-dd3a-4c19-9441-01049d848740+6:2388:x1875765545266304:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869838.967670:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31cd0bfc-dd3a-4c19-9441-01049d848740+6:2388:x1875765545266304:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869838.967676:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:3.0:1788869838.967691:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:3.0:1788869838.967697:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+5:2388:x1875765545265920:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869838.967718:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+5:2388:x1875765545265920:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869838.967723:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:3.0:1788869838.967732:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:3.0:1788869838.967737:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31cd0bfc-dd3a-4c19-9441-01049d848740+5:2388:x1875765545266432:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869838.967753:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31cd0bfc-dd3a-4c19-9441-01049d848740+5:2388:x1875765545266432:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 16us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869838.967759:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:1.0:1788869838.968465:0:19702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00080000:1.0:1788869838.969146:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869838.969160:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869838.969162:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869838.969165:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1788869839.260176:0:19482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 31cd0bfc-dd3a-4c19-9441-01049d848740 00000001:00100000:1.0:1788869839.268341:0:18663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 31cd0bfc-dd3a-4c19-9441-01049d848740 00010000:00010000:2.0:1788869839.705739:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869839.769726:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554779904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869839.769858:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869839.769996:0:17901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554779904 00000100:00100000:0.0:1788869839.770004:0:17901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554779904 00000100:00100000:0.0:1788869839.770061:0:17901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788869839.770071:0:17901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554779904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788869839.770106:0:17901:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788869839.770162:0:17901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554779904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869839.770169:0:17901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788869839.770558:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554779904:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869839.780446:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869839.780470:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554780032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869839.780585:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869839.780650:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554780032 00000100:00100000:3.0:1788869839.780658:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554780032 00000100:00100000:3.0:1788869839.780705:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788869839.780713:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554780032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869839.780746:0:17166:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788869839.780810:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554780032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869839.780818:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788869839.780863:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554780032:0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1788869840.391378:0:20189:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc338ad370 20000000:00000080:2.0:1788869840.391396:0:20189:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99ffba992000 uarg=0000000000000000 20000000:01000000:2.0:1788869840.391483:0:20189:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788869840.391490:0:20189:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788869840.391495:0:20189:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788869840.392333:0:20190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788869840.392505:0:20189:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788869840.403365:0:20189:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788869840.403538:0:20189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99fe823c1000/0xbead52e175fc42a1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.403576:0:20189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ff80031200/0xbead52e175fc3f36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3f2f expref: 23 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.403773:0:20189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffbfb04200/0xbead52e175fc3f44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3f3d expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.403780:0:20189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fe823c0a00/0xbead52e175fc3f83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc3f7c expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.403787:0:20189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ffb9a9ec00/0xbead52e175fc401d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc4016 expref: 23 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.403795:0:20189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fe823c1400/0xbead52e175fc4231 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae0c expref: 12 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.403801:0:20189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99fe823c1800/0xbead52e175fc4270 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae7c expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.403809:0:20189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99fe823c1000/0xbead52e175fc42a1 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.403858:0:20189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fe823c1800/0xbead52e175fc4270 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae7c expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.403875:0:20189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fe823c1800/0xbead52e175fc4270 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae7c expref: 12 pid: 17154 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869840.403892:0:20189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875765554780160:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788869840.404234:0:20189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fe823c1400/0xbead52e175fc4231 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae0c expref: 12 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.404860:0:20189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fe823c1400/0xbead52e175fc4231 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae0c expref: 12 pid: 17153 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869840.404873:0:20189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875765554780288:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788869840.404930:0:20189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffb9a9ec00/0xbead52e175fc401d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc4016 expref: 23 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.404938:0:20189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffb9a9ec00/0xbead52e175fc401d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc4016 expref: 23 pid: 17155 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869840.404947:0:20189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875765554780416:0@lo:104: 00000100:00100000:2.0:1788869840.404986:0:20189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869840.405079:0:20189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99fe823c0a00/0xbead52e175fc3f83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc3f7c expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.405087:0:20189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99fe823c0a00/0xbead52e175fc3f83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc3f7c expref: 23 pid: 17154 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869840.405095:0:20189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875765554780544:0@lo:104: 00000100:00100000:2.0:1788869840.405127:0:20189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869840.405402:0:20189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ffbfb04200/0xbead52e175fc3f44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc3f3d expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.405411:0:20189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ffbfb04200/0xbead52e175fc3f44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc3f3d expref: 23 pid: 17154 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869840.405421:0:20189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875765554780672:0@lo:104: 00000100:00100000:2.0:1788869840.405444:0:20189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869840.405605:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554780416 00000100:00100000:0.0:1788869840.405623:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554780416 00000100:00100000:1.0:1788869840.405740:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554780544 00000100:00100000:1.0:1788869840.405745:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554780544 00000100:00100000:1.0:1788869840.405814:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788869840.405823:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+4:20189:x1875765554780416:12345-0@lo:104: 00010000:00010000:1.0:1788869840.405837:0:17144:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99fe823c0200/0xbead52e175fc4016 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc401d expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.405894:0:17144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788869840.405900:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+4:20189:x1875765554780416:12345-0@lo:104: Request processed in 79us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869840.405906:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788869840.405923:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869840.405929:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+3:20189:x1875765554780544:12345-0@lo:104: 00010000:00010000:1.0:1788869840.405936:0:17144:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3f7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3f83 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.405970:0:17144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788869840.405976:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+3:20189:x1875765554780544:12345-0@lo:104: Request processed in 48us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869840.405981:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788869840.406000:0:19701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788869840.406012:0:19701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99fe823c0200/0xbead52e175fc4016 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc401d expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.406019:0:19701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0200 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1788869840.406023:0:19701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99fe823c0200/0xbead52e175fc4016 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc401d expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.406031:0:19701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99fe823c0200/0xbead52e175fc4016 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc401d expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869840.406038:0:19701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99fe823c0200/0xbead52e175fc4016 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc401d expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869840.406043:0:19701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788869840.406206:0:19701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99fe823c0200/0xbead52e175fc4016 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc401d expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.406213:0:19701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869840.406232:0:19701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99fe823c0200/0xbead52e175fc4016 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc401d expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.406238:0:19701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99fe823c0200/0xbead52e175fc4016 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc401d expref: -99 pid: 19481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.406278:0:19701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869840.406281:0:19701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3f7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3f83 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.406287:0:19701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb9a9f400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1788869840.406290:0:19701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3f7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc3f83 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.406307:0:19701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3f7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc3f83 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869840.406313:0:19701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3f7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc3f83 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869840.406317:0:19701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788869840.406331:0:19701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3f7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3f83 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.406337:0:19701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869840.406344:0:19701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3f7c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3f83 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.406350:0:19701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ffb9a9f400/0xbead52e175fc3f7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3f83 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.406358:0:19701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869840.406360:0:19701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869840.406362:0:19701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869840.406382:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe83a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3618:1875765554780800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869840.406413:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869840.406438:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869840.406443:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3618:1875765554780928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869840.406464:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869840.406492:0:18314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554780800 00000100:00100000:1.0:1788869840.406496:0:18314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554780800 00010000:00010000:1.0:1788869840.406512:0:18314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffb9a9ec00/0xbead52e175fc401d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc4016 expref: 24 pid: 17155 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869840.406544:0:18314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554780928 00000100:00100000:1.0:1788869840.406547:0:18314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554780928 00010000:00010000:1.0:1788869840.406559:0:18314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fe823c0a00/0xbead52e175fc3f83 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3f7c expref: 25 pid: 17154 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869840.406699:0:18314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788869840.406709:0:18314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+25:3618:x1875765554780800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869840.406733:0:18314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869840.406738:0:18314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffb9a9ec00/0xbead52e175fc401d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc4016 expref: 25 pid: 17155 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.406747:0:18314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffb9a9ec00/0xbead52e175fc401d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc4016 expref: 25 pid: 17155 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.406763:0:18314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869840.406788:0:18314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+25:3618:x1875765554780800:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869840.406794:0:18314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788869840.406807:0:18314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869840.406812:0:18314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:3618:x1875765554780928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869840.406819:0:18314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869840.406822:0:18314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fe823c0a00/0xbead52e175fc3f83 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3f7c expref: 24 pid: 17154 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.406830:0:18314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fe823c0a00/0xbead52e175fc3f83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc3f7c expref: 24 pid: 17154 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.406839:0:18314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869840.406863:0:18314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:3618:x1875765554780928:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869840.406869:0:18314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869840.406907:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3618:1875765554780928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869840.406915:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe83a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3618:1875765554780800:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869840.407199:0:20189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ff80031200/0xbead52e175fc3f36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbead52e175fc3f2f expref: 23 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.407210:0:20189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ff80031200/0xbead52e175fc3f36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbead52e175fc3f2f expref: 23 pid: 17153 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869840.407220:0:20189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875765554781056:0@lo:104: 00000100:00100000:2.0:1788869840.407270:0:20189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869840.407285:0:20189:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae73fd80 going to sleep for 11 seconds 00010000:00010000:2.0:1788869840.407298:0:20189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffb9a9ec00/0xbead52e175fc401d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc4016 expref: 23 pid: 17155 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869840.407311:0:20189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875765554780416:0@lo:104: 00010000:00010000:2.0:1788869840.407320:0:20189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fe823c0a00/0xbead52e175fc3f83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc3f7c expref: 22 pid: 17154 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869840.407327:0:20189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875765554780544:0@lo:104: 00010000:00010000:2.0:1788869840.407358:0:19700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869840.407419:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554780672 00000100:00100000:1.0:1788869840.407423:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554780672 00000100:00100000:1.0:1788869840.407445:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554781056 00000100:00100000:1.0:1788869840.407447:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554781056 00000100:00100000:1.0:1788869840.407459:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788869840.407464:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+4:20189:x1875765554780672:12345-0@lo:104: 00010000:00010000:1.0:1788869840.407472:0:17144:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc3f3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3f44 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.407526:0:17144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788869840.407531:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+4:20189:x1875765554780672:12345-0@lo:104: Request processed in 67us (2086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869840.407536:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788869840.407548:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788869840.407553:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84042d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+3:20189:x1875765554781056:12345-0@lo:104: 00010000:00010000:1.0:1788869840.407561:0:17144:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff99fe823c0400/0xbead52e175fc3f2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3f36 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869840.414086:0:20189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6ad500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875765554780672:0@lo:104: 00010000:00010000:0.0:1788869840.415159:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869840.415171:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc3f3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3f44 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869840.415183:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031000 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:0.0:1788869840.415187:0:17149:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc3f3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc3f44 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869840.415198:0:17149:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc3f3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc3f44 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869840.415220:0:17149:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc3f3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc3f44 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869840.415226:0:17149:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788869840.415308:0:17149:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc3f3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3f44 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869840.415315:0:17149:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869840.415337:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc3f3d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3f44 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869840.415344:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99ff80031000/0xbead52e175fc3f3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3f44 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869840.415356:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869840.415358:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869840.415360:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869840.415374:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3616:1875765554781184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869840.415430:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869840.415669:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869840.415966:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554781184 00000100:00100000:0.0:1788869840.415973:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554781184 00010000:00010000:0.0:1788869840.416004:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ffbfb04200/0xbead52e175fc3f44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3f3d expref: 22 pid: 17154 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869840.416031:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545266944 00000100:00100000:0.0:1788869840.416034:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545266944 00010000:00010000:0.0:1788869840.416056:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fe823c1400/0xbead52e175fc4231 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae0c expref: 13 pid: 17153 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869840.416076:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788869840.416092:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+22:3616:x1875765554781184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869840.416106:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869840.416111:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ffbfb04200/0xbead52e175fc3f44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3f3d expref: 22 pid: 17154 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869840.416121:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ffbfb04200/0xbead52e175fc3f44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc3f3d expref: 22 pid: 17154 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869840.416137:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ffbfb04200/0xbead52e175fc3f44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc3f3d expref: 22 pid: 17154 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869840.416150:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869840.416186:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:3616:x1875765554781184:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869840.416194:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788869840.416212:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1788869840.416232:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84040380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:2387:x1875765545266944:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869840.416241:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869840.416273:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fe823c1400/0xbead52e175fc4231 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae0c expref: 13 pid: 17153 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869840.416282:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fe823c1400/0xbead52e175fc4231 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae0c expref: 13 pid: 17153 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869840.416293:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869840.416329:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84040380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:2387:x1875765545266944:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 111us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869840.416335:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1788869840.416376:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3616:1875765554781184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869840.416867:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869840.416986:0:18314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545266816 00000100:00100000:1.0:1788869840.416991:0:18314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545266816 00010000:00010000:1.0:1788869840.417010:0:18314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99fe823c1800/0xbead52e175fc4270 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae7c expref: 13 pid: 17154 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869840.417038:0:18314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:1.0:1788869840.417144:0:18314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:2387:x1875765545266816:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869840.417154:0:18314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869840.417158:0:18314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99fe823c1800/0xbead52e175fc4270 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae7c expref: 13 pid: 17154 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.417167:0:18314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99fe823c1800/0xbead52e175fc4270 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae7c expref: 13 pid: 17154 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.417178:0:18314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869840.417202:0:18314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:2387:x1875765545266816:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 158us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869840.417208:0:18314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00010000:00010000:0.0:1788869840.417311:0:17144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788869840.417319:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84042d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+3:20189:x1875765554781056:12345-0@lo:104: Request processed in 9765us (10048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869840.417327:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869840.417457:0:20189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffae6aed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875765554781056:0@lo:104: 00010000:00010000:3.0:1788869840.417472:0:20189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fe823c1800/0xbead52e175fc4270 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae7c expref: 12 pid: 17154 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869840.421709:0:20189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875765554780160:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869840.421759:0:20189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fe823c1400/0xbead52e175fc4231 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae0c expref: 11 pid: 17153 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869840.421776:0:20189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20189:1875765554780288:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869840.421811:0:20189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99fe823c1000/0xbead52e175fc42a1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869840.422372:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869840.422381:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff99fe823c0400/0xbead52e175fc3f2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbead52e175fc3f36 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869840.422390:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1788869840.422395:0:17148:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff99fe823c0400/0xbead52e175fc3f2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbead52e175fc3f36 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869840.422406:0:17148:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff99fe823c0400/0xbead52e175fc3f2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbead52e175fc3f36 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869840.422415:0:17148:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff99fe823c0400/0xbead52e175fc3f2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbead52e175fc3f36 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869840.422421:0:17148:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788869840.422481:0:17148:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff99fe823c0400/0xbead52e175fc3f2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3f36 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869840.422488:0:17148:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869840.422513:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff99fe823c0400/0xbead52e175fc3f2f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3f36 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869840.422535:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff99fe823c0400/0xbead52e175fc3f2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbead52e175fc3f36 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869840.422552:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869840.422554:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869840.422556:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869840.422574:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3617:1875765554781312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869840.422796:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869840.422892:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554781312 00000100:00100000:0.0:1788869840.422901:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554781312 00010000:00010000:0.0:1788869840.422935:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ff80031200/0xbead52e175fc3f36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3f2f expref: 21 pid: 17153 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869840.422976:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788869840.422986:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82229f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:3617:x1875765554781312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869840.422999:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869840.423005:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ff80031200/0xbead52e175fc3f36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbead52e175fc3f2f expref: 21 pid: 17153 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869840.423017:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ff80031200/0xbead52e175fc3f36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbead52e175fc3f2f expref: 21 pid: 17153 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869840.423033:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ff80031200/0xbead52e175fc3f36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbead52e175fc3f2f expref: 21 pid: 17153 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869840.423063:0:17145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99fe823c1000/0xbead52e175fc42a1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869840.423072:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fe823c1000/0xbead52e175fc42a1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869840.423087:0:17145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99fe823c1000/0xbead52e175fc42a1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869840.423107:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99fe823c1000/0xbead52e175fc42a1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869840.423114:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99fe823c1000/0xbead52e175fc42a1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869840.423119:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99fe823c1000/0xbead52e175fc42a1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869840.423124:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1000 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:0.0:1788869840.423128:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99fe823c1000/0xbead52e175fc42a1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869840.423136:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99fe823c1000/0xbead52e175fc42a1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869840.423159:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99fe823c1000/0xbead52e175fc42a1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869840.423170:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869840.423214:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82229f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+20:3617:x1875765554781312:12345-0@lo:103:ldlm_bl.0 Request processed in 229us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869840.423221:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788869840.423289:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3617:1875765554781312:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788869840.423478:0:20189:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99fe823c1000/0xbead52e175fc42a1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869840.423487:0:20189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99fe823c1000/0xbead52e175fc42a1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869840.423493:0:20189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99fe823c1000/0xbead52e175fc42a1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.728537:0:19701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869841.304799:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554781568:0@lo:400:kworker.0 00000100:00100000:0.0:1788869841.304867:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869841.304897:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554782080:0@lo:400:kworker.0 00000100:00100000:0.0:1788869841.304919:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869841.304944:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554782592:0@lo:400:kworker.0 00000100:00100000:0.0:1788869841.304969:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869841.305044:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554783104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869841.305069:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869841.305088:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1788869841.305095:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3619:1875765554781440:0@lo:400:kworker.0 00000100:00100000:0.0:1788869841.305121:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869841.305145:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554781952:0@lo:400:kworker.0 00000100:00100000:0.0:1788869841.305163:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869841.305178:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875765554782464:0@lo:400:kworker.0 00000100:00100000:0.0:1788869841.305214:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869841.305242:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554781440 00000100:00100000:0.0:1788869841.305242:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554782976:0@lo:400:kworker.0 00000100:00100000:2.0:1788869841.305250:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554781440 00000100:00100000:0.0:1788869841.305300:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869841.305324:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554781696:0@lo:400:kworker.0 00000100:00100000:2.0:1788869841.305329:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788869841.305338:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+20:3619:x1875765554781440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869841.305348:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869841.305363:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554782208:0@lo:400:kworker.0 00000100:00100000:0.0:1788869841.305380:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869841.305387:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+20:3619:x1875765554781440:12345-0@lo:400:kworker.0 Request processed in 50us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869841.305392:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554782720:0@lo:400:kworker.0 00000100:00100000:2.0:1788869841.305394:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788869841.305410:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869841.305425:0:19498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554782592 00000100:00100000:0.0:1788869841.305427:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788869841.305429:0:19498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554782592 00000100:00100000:0.0:1788869841.305432:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554781824:0@lo:400:kworker.0 00000100:00100000:0.0:1788869841.305449:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869841.305462:0:19498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554781952 00000100:00100000:0.0:1788869841.305464:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554782336:0@lo:400:kworker.0 00000100:00100000:2.0:1788869841.305465:0:19498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554781952 00000100:00100000:2.0:1788869841.305475:0:19498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554782464 00000100:00100000:2.0:1788869841.305477:0:19498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554782464 00000100:00100000:0.0:1788869841.305482:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869841.305486:0:19498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554782976 00000100:00100000:2.0:1788869841.305488:0:19498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554782976 00000100:00100000:2.0:1788869841.305499:0:19498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554782720 00000100:00100000:2.0:1788869841.305501:0:19498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554782720 00000100:00100000:0.0:1788869841.305503:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875765554782848:0@lo:400:kworker.0 00000100:00100000:2.0:1788869841.305514:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788869841.305519:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554782592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869841.305522:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869841.305544:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554781568 00000100:00100000:0.0:1788869841.305547:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554781568 00000100:00100000:2.0:1788869841.305550:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875765554782592:12345-0@lo:400:kworker.0 Request processed in 31us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869841.305555:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788869841.305564:0:19498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554782848 00000100:00100000:2.0:1788869841.305567:0:19498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554782848 00000100:00100000:2.0:1788869841.305581:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788869841.305585:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554782080 00000100:00100000:2.0:1788869841.305586:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554781952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869841.305587:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554782080 00000100:00100000:0.0:1788869841.305600:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788869841.305606:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554781568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869841.305610:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875765554781952:12345-0@lo:400:kworker.0 Request processed in 25us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869841.305615:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788869841.305626:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788869841.305631:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875765554782464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869841.305633:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554781568:12345-0@lo:400:kworker.0 Request processed in 28us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869841.305639:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788869841.305651:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788869841.305652:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875765554782464:12345-0@lo:400:kworker.0 Request processed in 22us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869841.305656:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554782080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869841.305658:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788869841.305667:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788869841.305672:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875765554782976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869841.305678:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554782080:12345-0@lo:400:kworker.0 Request processed in 22us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869841.305683:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788869841.305692:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875765554782976:12345-0@lo:400:kworker.0 Request processed in 20us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869841.305701:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554783104 00000100:00100000:2.0:1788869841.305703:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788869841.305704:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554783104 00000100:00100000:2.0:1788869841.305712:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788869841.305718:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554782720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869841.305725:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788869841.305730:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554783104:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869841.305747:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554782720:12345-0@lo:400:kworker.0 Request processed in 29us (336us total) trans 0 rc 0/0 00002000:00000024:0.0:1788869841.305749:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788869841.305752:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788869841.305763:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788869841.305768:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875765554782848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869841.305777:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875765554783104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869841.305783:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788869841.305788:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875765554782848:12345-0@lo:400:kworker.0 Request processed in 21us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869841.305793:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788869841.305820:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875765554782848:0@lo:400:kworker.0 00000100:00100000:2.0:1788869841.305827:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554781696 00000100:00100000:2.0:1788869841.305830:0:19213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554781696 00010000:00080000:0.0:1788869841.305833:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe81c8f800 x1875765554782720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869841.305851:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554782208 00000100:00100000:2.0:1788869841.305853:0:19213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554782208 00000100:00100000:0.0:1788869841.305854:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554782720:0@lo:400:kworker.0 00000100:00100000:2.0:1788869841.305862:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554781824 00000100:00100000:2.0:1788869841.305864:0:19213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554781824 00000100:00100000:2.0:1788869841.305871:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554782336 00000100:00100000:2.0:1788869841.305873:0:19213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554782336 00000100:00100000:0.0:1788869841.305883:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3619:1875765554781440:0@lo:400:kworker.0 00000100:00100000:2.0:1788869841.305884:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788869841.305890:0:19213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554781696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869841.305893:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875765554781952:0@lo:400:kworker.0 00000100:00100000:0.0:1788869841.305901:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875765554782464:0@lo:400:kworker.0 00010000:00080000:0.0:1788869841.305910:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99fe81c8d880 x1875765554782976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869841.305918:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875765554782976:0@lo:400:kworker.0 00000100:00100000:2.0:1788869841.305920:0:19213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554781696:12345-0@lo:400:kworker.0 Request processed in 31us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869841.305926:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788869841.305931:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554783104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869841.305935:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788869841.305939:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875765554781568:0@lo:400:kworker.0 00000100:00100000:2.0:1788869841.305941:0:19213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554782208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869841.305946:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554782080:0@lo:400:kworker.0 00000100:00100000:0.0:1788869841.305954:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875765554782592:0@lo:400:kworker.0 00000100:00100000:2.0:1788869841.305973:0:19213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554782208:12345-0@lo:400:kworker.0 Request processed in 32us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869841.305978:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788869841.305983:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554781696:0@lo:400:kworker.0 00000100:00100000:2.0:1788869841.305988:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788869841.305991:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554782208:0@lo:400:kworker.0 00000100:00100000:2.0:1788869841.305994:0:19213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554781824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869841.306030:0:19213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554781824:12345-0@lo:400:kworker.0 Request processed in 37us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869841.306034:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554781824:0@lo:400:kworker.0 00000100:00100000:2.0:1788869841.306036:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788869841.306046:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788869841.306051:0:19213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554782336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869841.306084:0:19213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554782336:12345-0@lo:400:kworker.0 Request processed in 32us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869841.306089:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788869841.306089:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554782336:0@lo:400:kworker.0 00000100:00100000:0.0:1788869841.307097:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554783232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869841.307139:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869841.307620:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554783232 00000100:00100000:0.0:1788869841.307638:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554783232 00000100:00100000:0.0:1788869841.307672:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788869841.307678:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554783232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869841.307706:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788869841.307791:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554783232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869841.307799:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788869841.307860:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554783232:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788869841.308883:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869841.308890:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869841.308894:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869841.308896:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869841.309012:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554783360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869841.309063:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869841.309148:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554783360 00000100:00100000:1.0:1788869841.309154:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554783360 00000100:00100000:1.0:1788869841.309196:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788869841.309205:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554783360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788869841.309223:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788869841.309313:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554783360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869841.309321:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788869841.309375:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554783360:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788869841.752592:0:19700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869841.961146:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869841.961242:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545267072 00000100:00100000:2.0:1788869841.961309:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545267072 00000100:00100000:2.0:1788869841.961364:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 146 00000100:00100000:2.0:1788869841.961374:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10bffde-eac0-4cc8-9215-f0ed84a241b8+11:14907:x1875765545267072:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869841.961393:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869841.961413:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fe823c1000/0xbead52e175fc42a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaeb4 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869841.961442:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fe823c1000/0xbead52e175fc42a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaeb4 expref: 12 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869841.961464:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fe823c1000/0xbead52e175fc42a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaeb4 expref: 12 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869841.961474:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1000, rc 0) 00000100:00100000:2.0:1788869841.961533:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10bffde-eac0-4cc8-9215-f0ed84a241b8+12:14907:x1875765545267072:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 160us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869841.961541:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 146 00000100:00100000:0.0:1788869841.967466:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869841.967537:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545267200 00000100:00100000:3.0:1788869841.967547:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545267200 00000100:00100000:3.0:1788869841.967608:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 147 00000100:00100000:3.0:1788869841.967619:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+12:14907:x1875765545267200:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869841.967777:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+12:14907:x1875765545267200:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 159us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869841.967785:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 147 00000100:00100000:2.0:1788869841.973700:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869841.973779:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545267328 00000100:00100000:3.0:1788869841.973793:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545267328 00000100:00100000:3.0:1788869841.973859:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 148 00000100:00100000:3.0:1788869841.973870:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83941050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+12:14907:x1875765545267328:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869841.974033:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83941050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+12:14907:x1875765545267328:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 164us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869841.974042:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 148 00000100:00100000:2.0:1788869841.991543:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869841.991658:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545267456 00000100:00100000:3.0:1788869841.991669:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545267456 00000100:00100000:3.0:1788869841.991772:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 149 00000100:00100000:3.0:1788869841.991789:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe83940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10bffde-eac0-4cc8-9215-f0ed84a241b8+12:14907:x1875765545267456:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869841.991809:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869841.991829:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ff81534800/0xbead52e175fc42af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaebb expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869841.991859:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ff81534800/0xbead52e175fc42af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaebb expref: 13 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869841.991871:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ff81534800/0xbead52e175fc42af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaebb expref: 13 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869841.991880:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534800, rc 0) 00000100:00100000:3.0:1788869841.991947:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe83940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:14907:x1875765545267456:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 161us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869841.992129:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 149 00000100:00100000:2.0:1788869841.999823:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869842.000086:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545267584 00000100:00100000:1.0:1788869842.000096:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545267584 00000100:00100000:1.0:1788869842.000210:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 150 00000100:00100000:1.0:1788869842.000229:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe832f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:14907:x1875765545267584:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869842.000385:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe832f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:14907:x1875765545267584:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 158us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869842.000392:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 150 00000100:00100000:2.0:1788869842.014403:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869842.014598:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545267712 00000100:00100000:1.0:1788869842.014608:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545267712 00000100:00100000:1.0:1788869842.014658:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 151 00000100:00100000:1.0:1788869842.014667:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:14907:x1875765545267712:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869842.014778:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:14907:x1875765545267712:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 112us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869842.014784:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 151 10000000:01000000:1.0:1788869842.073378:0:17157:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788869842.073387:0:17157:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ffbab91000 from 13 10000000:01000000:1.0:1788869842.073394:0:17157:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869842.073453:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc42b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869842.073467:0:17157:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc42b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869842.073479:0:17157:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc42b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869842.073508:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb47b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554783488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869842.073601:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869842.073664:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb88c3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869842.073748:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554783488 00000100:00100000:2.0:1788869842.073757:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554783488 00000100:00100000:2.0:1788869842.073815:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788869842.073826:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+20:17157:x1875765554783488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869842.073839:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869842.073856:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99fe823c1800/0xbead52e175fc42bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc42b6 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869842.073885:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99fe823c1800/0xbead52e175fc42bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc42b6 expref: 21 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869842.073897:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99fe823c1800/0xbead52e175fc42bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc42b6 expref: 21 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869842.073906:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1800, rc 0) 00000100:00100000:2.0:1788869842.073956:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:17157:x1875765554783488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869842.073969:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788869842.074071:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb47b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554783488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869842.074088:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc42b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc42bd expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869842.074105:0:17157:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc42b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc42bd expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869842.074187:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82228e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554783616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869842.074237:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869842.074310:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869842.074373:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554783616 00000100:00100000:0.0:1788869842.074378:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554783616 00000100:00100000:0.0:1788869842.074403:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788869842.074410:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:17157:x1875765554783616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869842.074553:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:17157:x1875765554783616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869842.074561:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788869842.074632:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82228e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554783616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869842.074664:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82228e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554783744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869842.074712:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869842.074731:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869842.074774:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554783744 00000100:00100000:0.0:1788869842.074778:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554783744 00000100:00100000:0.0:1788869842.074794:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788869842.074799:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:17157:x1875765554783744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869842.074886:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:17157:x1875765554783744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869842.074894:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788869842.075017:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82228e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554783744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788869842.076343:0:20268:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788869842.076724:0:17157:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788869842.076754:0:17157:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788869842.076770:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc42b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc42bd expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869842.076802:0:17157:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffb95a8800/0xbead52e175fc42b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc42bd expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869842.076813:0:17157:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788869842.076816:0:17157:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99fe81cb4800 from 13 10000000:01000000:0.0:1788869842.076820:0:17157:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788869842.076865:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04e00/0xbead52e175fc42c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869842.076872:0:17157:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04e00/0xbead52e175fc42c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869842.076883:0:17157:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04e00/0xbead52e175fc42c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869842.076913:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff88011c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554783872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869842.077000:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869842.077379:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffa5db26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869842.077490:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554783872 00000100:00100000:1.0:1788869842.077499:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554783872 00000100:00100000:1.0:1788869842.077587:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788869842.077598:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+21:17157:x1875765554783872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869842.077613:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869842.077629:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb95a9800/0xbead52e175fc42cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc42c4 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869842.077657:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb95a9800/0xbead52e175fc42cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc42c4 expref: 22 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869842.077668:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb95a9800/0xbead52e175fc42cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc42c4 expref: 22 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869842.077678:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a9800, rc 0) 00000100:00100000:1.0:1788869842.077774:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+22:17157:x1875765554783872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869842.077781:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788869842.078084:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff88011c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554783872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869842.078103:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04e00/0xbead52e175fc42c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc42cb expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869842.078113:0:17157:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04e00/0xbead52e175fc42c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc42cb expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869842.078183:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff88011c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554784000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869842.078350:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869842.078397:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffa5db26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869842.078460:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554784000 00000100:00100000:2.0:1788869842.078466:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554784000 00000100:00100000:2.0:1788869842.078501:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788869842.078508:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+22:17157:x1875765554784000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869842.078645:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+22:17157:x1875765554784000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869842.078652:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788869842.078750:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff88011c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554784000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869842.078781:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff88011c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554784128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869842.078825:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869842.078846:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffa5db26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869842.078977:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554784128 00000100:00100000:2.0:1788869842.078982:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554784128 00000100:00100000:2.0:1788869842.079052:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788869842.079060:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+22:17157:x1875765554784128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869842.079161:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+22:17157:x1875765554784128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869842.079167:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788869842.079486:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff88011c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554784128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788869842.080544:0:20269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788869842.080774:0:17157:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788869842.080800:0:17157:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788869842.080814:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04e00/0xbead52e175fc42c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc42cb expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869842.080828:0:17157:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ffbfb04e00/0xbead52e175fc42c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc42cb expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869842.080839:0:17157:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788869842.080842:0:17157:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99ffbf9b2000 from 13 10000000:01000000:2.0:1788869842.080845:0:17157:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788869842.080888:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99fe823c0200/0xbead52e175fc42d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869842.080912:0:17157:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99fe823c0200/0xbead52e175fc42d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869842.080923:0:17157:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99fe823c0200/0xbead52e175fc42d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869842.080947:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84041500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554784256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869842.081090:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869842.081148:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae6dc300 going to sleep for 11 seconds 00000100:00100000:1.0:1788869842.081341:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554784256 00000100:00100000:1.0:1788869842.081349:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554784256 00000100:00100000:1.0:1788869842.081400:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788869842.081411:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff8818fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+22:17157:x1875765554784256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869842.081425:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869842.081440:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffb95a9a00/0xbead52e175fc42d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc42d2 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869842.081470:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffb95a9a00/0xbead52e175fc42d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc42d2 expref: 23 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869842.081491:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffb95a9a00/0xbead52e175fc42d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc42d2 expref: 23 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869842.081500:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a9a00, rc 0) 00000100:00100000:1.0:1788869842.081555:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff8818fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+23:17157:x1875765554784256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869842.081562:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788869842.081728:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84041500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554784256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869842.081743:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99fe823c0200/0xbead52e175fc42d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc42d9 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869842.081752:0:17157:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99fe823c0200/0xbead52e175fc42d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc42d9 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869842.081807:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84041500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554784384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869842.081834:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869842.081861:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae6dc300 going to sleep for 11 seconds 00000100:00100000:1.0:1788869842.081906:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554784384 00000100:00100000:1.0:1788869842.081909:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554784384 00000100:00100000:1.0:1788869842.081939:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788869842.081946:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffa00a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+23:17157:x1875765554784384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869842.082180:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffa00a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+23:17157:x1875765554784384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869842.082188:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788869842.082460:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84041500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554784384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869842.082489:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84041500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554784512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869842.082533:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869842.082585:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae6dc300 going to sleep for 11 seconds 00000100:00100000:0.0:1788869842.082644:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554784512 00000100:00100000:0.0:1788869842.082649:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554784512 00000100:00100000:0.0:1788869842.082685:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788869842.082692:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffa00a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+23:17157:x1875765554784512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869842.082785:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffa00a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+23:17157:x1875765554784512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869842.082792:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788869842.082862:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84041500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554784512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788869842.088604:0:20270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788869842.088873:0:17157:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788869842.088895:0:17157:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788869842.088908:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99fe823c0200/0xbead52e175fc42d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc42d9 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869842.088921:0:17157:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99fe823c0200/0xbead52e175fc42d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc42d9 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869842.088933:0:17157:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788869842.088936:0:17157:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99fe81f16800 from 13 10000000:01000000:3.0:1788869842.088938:0:17157:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788869842.088983:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81534600/0xbead52e175fc42e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869842.089002:0:17157:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff99ff81534600/0xbead52e175fc42e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869842.089653:0:17157:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff99ff81534600/0xbead52e175fc42e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869842.089682:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82228e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554784640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788869842.089759:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869842.089847:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869842.089894:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554784640 00000100:00100000:0.0:1788869842.089902:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554784640 00000100:00100000:0.0:1788869842.090000:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788869842.090086:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffa00a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+23:17157:x1875765554784640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869842.090107:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869842.090365:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ffbfb04200/0xbead52e175fc42e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbead52e175fc42e0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869842.090395:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ffbfb04200/0xbead52e175fc42e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbead52e175fc42e0 expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869842.090406:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ffbfb04200/0xbead52e175fc42e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbead52e175fc42e0 expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869842.090432:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb04200, rc 0) 00000100:00100000:0.0:1788869842.090490:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffa00a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:17157:x1875765554784640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 480us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869842.090497:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788869842.090578:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82228e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554784640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869842.090596:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff99ff81534600/0xbead52e175fc42e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc42e7 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869842.090607:0:17157:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff99ff81534600/0xbead52e175fc42e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbead52e175fc42e7 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869842.090686:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82228e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554784768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869842.090717:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869842.090894:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b669c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869842.090952:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554784768 00000100:00100000:1.0:1788869842.090957:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554784768 00000100:00100000:2.0:1788869842.090997:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788869842.091007:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:17157:x1875765554784768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869842.091152:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:17157:x1875765554784768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869842.091159:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788869842.091378:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82228e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554784768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869842.091413:0:17157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82228e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554784896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869842.091457:0:17157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869842.091481:0:17157:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb9b669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869842.091608:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554784896 00000100:00100000:2.0:1788869842.091612:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554784896 00000100:00100000:2.0:1788869842.091634:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788869842.091641:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:17157:x1875765554784896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869842.091736:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:17157:x1875765554784896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869842.091743:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788869842.091814:0:17157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82228e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:17157:1875765554784896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788869842.092958:0:20271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788869842.093536:0:17157:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788869842.093557:0:17157:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788869842.093568:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff99ff81534600/0xbead52e175fc42e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc42e7 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869842.093579:0:17157:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff99ff81534600/0xbead52e175fc42e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbead52e175fc42e7 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869842.144063:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788869842.776424:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869843.619702:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869843.619815:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545267840 00000100:00100000:0.0:1788869843.619825:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545267840 00000100:00100000:0.0:1788869843.619907:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:0.0:1788869843.619920:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:15577:x1875765545267840:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869843.619942:0:17160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869843.619969:0:17160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc42ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaec2 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620040:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc42f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620057:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc42f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620072:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc42f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620088:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05e00/0xbead52e175fc42fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620095:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05e00/0xbead52e175fc42fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620102:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05e00/0xbead52e175fc42fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620235:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc4303 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620243:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc4303 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620440:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc4303 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869843.620478:0:17160:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788869843.620482:0:17160:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869843.620516:0:17160:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc4303 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620527:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc42f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620534:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc42f5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620540:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc42f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620547:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869843.620551:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc42f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620559:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc42f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620571:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff8990da00) 00010000:00010000:0.0:1788869843.620581:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869843.620586:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc42f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620593:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc42f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620610:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05e00/0xbead52e175fc42fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620617:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05e00/0xbead52e175fc42fc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620623:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05e00/0xbead52e175fc42fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620628:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05e00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869843.620631:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05e00/0xbead52e175fc42fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620637:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05e00/0xbead52e175fc42fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620644:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99fe81f9b300) 00010000:00010000:0.0:1788869843.620647:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869843.620650:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05e00/0xbead52e175fc42fc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620655:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05e00/0xbead52e175fc42fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620687:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc42ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaec2 expref: 8 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620716:0:17160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031200/0xbead52e175fc4303 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaec2 expref: 7 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.620723:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99fe81f9bd00) 00010000:00010000:0.0:1788869843.620726:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869843.620728:0:17160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff80031200, rc 0) 00000100:00100000:0.0:1788869843.620841:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+7:15577:x1875765545267840:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 924us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869843.620850:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00080000:1.0:1788869843.621372:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869843.627197:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869843.629412:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545267968 00000100:00100000:3.0:1788869843.629428:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545267968 00000100:00100000:3.0:1788869843.629509:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:3.0:1788869843.629526:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+7:15577:x1875765545267968:12345-192.168.201.30@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788869843.631407:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+7:15577:x1875765545267968:12345-192.168.201.30@tcp:900:lhsmtool_posix.0 Request processed in 1878us (4221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869843.631421:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:2.0:1788869843.642074:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869843.642199:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545268224 00000100:00100000:3.0:1788869843.642212:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545268224 00000100:00100000:3.0:1788869843.642326:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:3.0:1788869843.642337:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+7:15577:x1875765545268224:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869843.642357:0:17162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869843.642378:0:17162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534e00/0xbead52e175fc430a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaec9 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.642457:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc4311 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.642473:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc4311 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.642485:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc4311 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.642545:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc4318 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.642553:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc4318 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.642579:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc4318 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.642801:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc431f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.642813:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc431f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.642823:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc431f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869843.642835:0:17162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788869843.643471:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc4311 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.643481:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc4311 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.643488:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc4311 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.643495:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869843.643499:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc4311 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.643507:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc4311 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.643521:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99fe81f9bd00) 00010000:00010000:3.0:1788869843.643524:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869843.643536:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc4311 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.643543:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc4311 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.643560:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc4318 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.643566:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc4318 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.643572:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc4318 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.643578:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869843.643581:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc4318 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.643587:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc4318 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.643595:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99fe820c1f00) 00010000:00010000:3.0:1788869843.643597:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869843.643600:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc4318 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.643605:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc4318 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.645548:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534e00/0xbead52e175fc430a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaec9 expref: 10 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.645595:0:17162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535400/0xbead52e175fc431f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaec9 expref: 9 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.645604:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99fe820c1600) 00010000:00010000:3.0:1788869843.645607:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869843.645610:0:17162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81535400, rc 0) 00000100:00100000:3.0:1788869843.645692:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+9:15577:x1875765545268224:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 3356us (3626us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788869843.645703:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:1.0:1788869843.664518:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869843.664628:0:19497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545268352 00000100:00100000:2.0:1788869843.664639:0:19497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545268352 00000100:00100000:2.0:1788869843.664701:0:19497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:2.0:1788869843.664712:0:19497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+9:15577:x1875765545268352:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788869843.664847:0:19497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+9:15577:x1875765545268352:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 Request processed in 137us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869843.664855:0:19497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:2.0:1788869843.679904:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869843.681388:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545268480 00000100:00100000:0.0:1788869843.681401:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545268480 00000100:00100000:0.0:1788869843.681496:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:0.0:1788869843.681508:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+5:15577:x1875765545268480:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1788869843.681794:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1788869843.684731:0:17160:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3179us 00000100:00100000:1.0:1788869843.711504:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+5:15577:x1875765545268480:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 Request processed in 29990us (31604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869843.711519:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:1.0:1788869843.723848:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869843.723945:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545268608 00000100:00100000:3.0:1788869843.723955:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545268608 00000100:00100000:3.0:1788869843.724036:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:3.0:1788869843.724046:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+9:15583:x1875765545268608:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869843.724068:0:17162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869843.724088:0:17162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534e00/0xbead52e175fc432d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaed0 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.724150:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc4334 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.724176:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc4334 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.724194:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc4334 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.724207:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc433b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.724227:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc433b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.724233:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc433b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.724305:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc4334 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.724314:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc4334 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.724320:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc4334 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.724340:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869843.724345:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc4334 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.724352:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc4334 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.724363:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff8990da00) 00010000:00010000:3.0:1788869843.724366:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869843.724371:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc4334 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.724376:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc4334 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.724390:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc433b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.724402:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc433b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.724407:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc433b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.724411:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869843.724413:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc433b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.724419:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc433b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.724425:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99fe820c1f00) 00010000:00010000:3.0:1788869843.724427:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869843.724430:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc433b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.724435:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc433b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.724466:0:17162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534e00/0xbead52e175fc432d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaed0 expref: 10 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.724476:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff8990da00) 00010000:00010000:3.0:1788869843.724478:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869843.724481:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534e00/0xbead52e175fc432d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaed0 expref: 10 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.724501:0:17162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534e00, rc 0) 00000100:00100000:3.0:1788869843.724564:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+9:15583:x1875765545268608:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 518us (724us total) trans 0 rc 301/301 00000100:00100000:3.0:1788869843.724571:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:0.0:1788869843.735958:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869843.737407:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545268736 00000100:00100000:3.0:1788869843.737420:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545268736 00000100:00100000:3.0:1788869843.737482:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:3.0:1788869843.737492:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+9:15583:x1875765545268736:12345-192.168.201.30@tcp:700:lfs.0 00000100:00100000:3.0:1788869843.737593:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+9:15583:x1875765545268736:12345-192.168.201.30@tcp:700:lfs.0 Request processed in 102us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869843.737601:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:2.0:1788869843.740961:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869843.741068:0:19498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545268992 00000100:00100000:3.0:1788869843.741079:0:19498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545268992 00000100:00100000:3.0:1788869843.741140:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:3.0:1788869843.741151:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+9:15583:x1875765545268992:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:3.0:1788869843.741232:0:19498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869843.741471:0:19498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535800/0xbead52e175fc425b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaae3d expref: 9 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.741493:0:19498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff8990da00) 00010000:00010000:3.0:1788869843.741500:0:19498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869843.741566:0:19498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc4342 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.741584:0:19498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc429a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaead expref: 5 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.741612:0:19498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc4342 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.741650:0:19498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc429a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaead expref: 5 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.741662:0:19498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc429a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaead expref: 5 pid: 19498 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869843.741676:0:19498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82228e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19498:1875765554785024:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869843.742065:0:19498:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffaf01fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869843.745789:0:19498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82228e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19498:1875765554785024:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869843.745817:0:19498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc4342 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869843.746240:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869843.751108:0:18314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545269120 00000100:00100000:1.0:1788869843.751141:0:18314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545269120 00010000:00010000:1.0:1788869843.751221:0:18314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc429a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaead expref: 6 pid: 19498 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869843.751287:0:18314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:1.0:1788869843.751298:0:18314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84040700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31cd0bfc-dd3a-4c19-9441-01049d848740+6:2388:x1875765545269120:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869843.751313:0:18314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869843.751321:0:18314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc429a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaead expref: 6 pid: 19498 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.751334:0:18314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc429a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaead expref: 6 pid: 19498 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.751357:0:18314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc429a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaead expref: 6 pid: 19498 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.751374:0:18314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff8990da00) 00010000:00010000:1.0:1788869843.751379:0:18314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc4342 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.751388:0:18314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc4342 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.751417:0:18314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc4342 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.751453:0:18314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869843.751511:0:18314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84040700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31cd0bfc-dd3a-4c19-9441-01049d848740+5:2388:x1875765545269120:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 216us (5273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869843.751528:0:18314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00010000:00010000:0.0:1788869843.751553:0:19498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc4342 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.751561:0:19498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc4342 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.751583:0:19498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc4349 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.751593:0:19498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc4349 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.751601:0:19498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc4349 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788869843.751701:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788869843.754442:0:19498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc4350 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.754467:0:19498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc4350 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.754477:0:19498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc4350 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869843.754496:0:19498:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000094940c22 reply state 0000000049d99048 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc4350 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.754508:0:19498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc4350 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.754515:0:19498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99fe81f9b400) 00010000:00010000:0.0:1788869843.754518:0:19498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869843.754522:0:19498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788869843.754528:0:19498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788869843.754539:0:19498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc4342 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.754545:0:19498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc4342 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.754553:0:19498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc4342 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.754560:0:19498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869843.754564:0:19498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc4342 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.754582:0:19498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc4342 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.754593:0:19498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ff8990da00) 00010000:00010000:0.0:1788869843.754595:0:19498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869843.754599:0:19498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc4342 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.754604:0:19498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc4342 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869843.754626:0:19498:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000094940c22 reply state 0000000049d99048 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc4349 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.754635:0:19498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc4349 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869843.754641:0:19498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99fe81f9b300) 00010000:00010000:0.0:1788869843.754644:0:19498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869843.754646:0:19498:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788869843.754786:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+10:15583:x1875765545268992:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 13633us (13836us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788869843.754795:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 28 00010000:00010000:3.0:1788869843.801019:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869843.855514:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869843.855608:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545269248 00000100:00100000:1.0:1788869843.855619:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545269248 00000100:00100000:1.0:1788869843.855682:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:1.0:1788869843.855692:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+10:15591:x1875765545269248:12345-192.168.201.30@tcp:101:lctl.0 00010000:00010000:1.0:1788869843.855716:0:17160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869843.855739:0:17160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc4357 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaed7 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.855802:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8a00/0xbead52e175fc435e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.855817:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8a00/0xbead52e175fc435e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.855828:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8a00/0xbead52e175fc435e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869843.855870:0:17160:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788869843.855874:0:17160:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869843.855910:0:17160:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8a00/0xbead52e175fc435e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.855946:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc4357 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaed7 expref: 12 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.855964:0:17160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8a00/0xbead52e175fc435e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaed7 expref: 11 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.856002:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fe831e6e00) 00010000:00010000:1.0:1788869843.856004:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869843.856007:0:17160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a8a00, rc 0) 00000100:00100000:1.0:1788869843.856070:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+11:15591:x1875765545269248:12345-192.168.201.30@tcp:101:lctl.0 Request processed in 379us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869843.856077:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:2.0:1788869843.865351:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554785152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869843.865425:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869843.865645:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554785152 00000100:00100000:1.0:1788869843.865654:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554785152 00000100:00100000:1.0:1788869843.865728:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788869843.865739:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554785152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869843.865769:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788869843.865825:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875765554785152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869843.865833:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788869843.865920:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875765554785152:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788869843.866000:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869843.910193:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869843.910321:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545269376 00000100:00100000:3.0:1788869843.910336:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545269376 00000100:00100000:3.0:1788869843.910420:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:3.0:1788869843.910433:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31cd0bfc-dd3a-4c19-9441-01049d848740+5:15592:x1875765545269376:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869843.910464:0:17162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869843.910504:0:17162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535800/0xbead52e175fc4365 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaede expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.910596:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534e00/0xbead52e175fc436c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.910636:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534e00/0xbead52e175fc436c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.910650:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534e00/0xbead52e175fc436c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869843.910710:0:17162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788869843.910714:0:17162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869843.910743:0:17162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534e00/0xbead52e175fc436c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.910773:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535800/0xbead52e175fc4365 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaede expref: 7 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.910799:0:17162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534e00/0xbead52e175fc436c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaede expref: 6 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.910810:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fe831e6e00) 00010000:00010000:3.0:1788869843.910814:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869843.910819:0:17162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534e00, rc 0) 00000100:00100000:3.0:1788869843.910905:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31cd0bfc-dd3a-4c19-9441-01049d848740+6:15592:x1875765545269376:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 474us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869843.910913:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:0.0:1788869843.915817:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869843.916021:0:19498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545269504 00000100:00100000:3.0:1788869843.916031:0:19498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545269504 00000100:00100000:3.0:1788869843.916104:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:3.0:1788869843.916113:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31cd0bfc-dd3a-4c19-9441-01049d848740+6:15592:x1875765545269504:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869843.916133:0:19498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869843.916166:0:19498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc4373 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaee5 expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916285:0:19498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc437a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916299:0:19498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc437a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916311:0:19498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc437a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916323:0:19498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc4381 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916330:0:19498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc4381 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916336:0:19498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc4381 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916422:0:19498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc4388 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916430:0:19498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc4388 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916436:0:19498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc4388 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869843.916474:0:19498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788869843.916477:0:19498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869843.916494:0:19498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc4388 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916514:0:19498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc437a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916520:0:19498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc437a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916527:0:19498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc437a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916534:0:19498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869843.916539:0:19498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc437a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916547:0:19498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc437a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916562:0:19498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fe831e6e00) 00010000:00010000:3.0:1788869843.916566:0:19498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869843.916571:0:19498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc437a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916578:0:19498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc437a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916597:0:19498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc4381 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916604:0:19498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc4381 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916610:0:19498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc4381 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916624:0:19498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869843.916628:0:19498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc4381 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916635:0:19498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc4381 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916645:0:19498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99fe81f9b300) 00010000:00010000:3.0:1788869843.916648:0:19498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869843.916651:0:19498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc4381 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916657:0:19498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc4381 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916689:0:19498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc4373 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaee5 expref: 8 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916702:0:19498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc4388 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaee5 expref: 7 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869843.916709:0:19498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99fe81f9b400) 00010000:00010000:3.0:1788869843.916711:0:19498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869843.916712:0:19498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534200, rc 0) 00000100:00100000:3.0:1788869843.916966:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31cd0bfc-dd3a-4c19-9441-01049d848740+7:15592:x1875765545269504:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 851us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869843.916975:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:0.0:1788869843.926662:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869843.928614:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545269632 00000100:00100000:2.0:1788869843.928630:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545269632 00000100:00080000:3.0:1788869843.928760:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869843.928805:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:0.0:1788869843.928824:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:31cd0bfc-dd3a-4c19-9441-01049d848740+5:15592:x1875765545269632:12345-192.168.201.30@tcp:900:lfs.0 00000100:00100000:0.0:1788869843.928956:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:31cd0bfc-dd3a-4c19-9441-01049d848740+5:15592:x1875765545269632:12345-192.168.201.30@tcp:900:lfs.0 Request processed in 137us (2303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869843.928967:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:0.0:1788869843.938376:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869843.938509:0:19497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545269888 00000100:00100000:2.0:1788869843.938527:0:19497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545269888 00000100:00100000:2.0:1788869843.938628:0:19497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:2.0:1788869843.938641:0:19497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31cd0bfc-dd3a-4c19-9441-01049d848740+7:15592:x1875765545269888:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1788869843.938664:0:19497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869843.938691:0:19497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc438f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaeec expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869843.938797:0:19497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788869843.938900:0:19497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc438f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaeec expref: 9 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869843.938913:0:19497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fe831e6e00) 00010000:00010000:2.0:1788869843.938916:0:19497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788869843.938921:0:19497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc438f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaeec expref: 9 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869843.938951:0:19497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1a00, rc 0) 00000100:00100000:2.0:1788869843.939032:0:19497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31cd0bfc-dd3a-4c19-9441-01049d848740+8:15592:x1875765545269888:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 394us (670us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788869843.939040:0:19497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:3.0:1788869843.943328:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869843.943518:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545270144 00000100:00100000:2.0:1788869843.943535:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545270144 00000100:00100000:2.0:1788869843.943615:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:2.0:1788869843.943627:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31cd0bfc-dd3a-4c19-9441-01049d848740+8:15592:x1875765545270144:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:2.0:1788869843.943682:0:17162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869843.943713:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc4388 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaee5 expref: 8 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869843.943733:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99fe81f9b400) 00010000:00010000:2.0:1788869843.943737:0:17162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869843.943761:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc439d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869843.943775:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc439d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869843.943787:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc439d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869843.944026:0:17162:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000002a61b4e reply state 00000000fd9d953e transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc439d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869843.944039:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc439d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869843.944125:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99fe81f9b400) 00010000:00010000:2.0:1788869843.944127:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788869843.944131:0:17162:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788869843.944140:0:17162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788869843.944241:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31cd0bfc-dd3a-4c19-9441-01049d848740+9:15592:x1875765545270144:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 616us (928us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788869843.944249:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:0.0:1788869843.953412:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869843.953710:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545270400 00000100:00100000:3.0:1788869843.953723:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545270400 00000100:00100000:3.0:1788869843.953836:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:3.0:1788869843.953851:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31cd0bfc-dd3a-4c19-9441-01049d848740+9:15592:x1875765545270400:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1788869843.954184:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31cd0bfc-dd3a-4c19-9441-01049d848740+10:15592:x1875765545270400:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 328us (778us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788869843.954194:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:0.0:1788869843.970764:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869843.971111:0:19498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545270656 00000100:00100000:1.0:1788869843.971125:0:19498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545270656 00000100:00100000:1.0:1788869843.971213:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:1.0:1788869843.971225:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31cd0bfc-dd3a-4c19-9441-01049d848740+10:15592:x1875765545270656:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1788869843.971302:0:19498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869843.971332:0:19498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc43a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaef3 expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.971444:0:19498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9e00/0xbead52e175fc43ab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.971722:0:19498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9e00/0xbead52e175fc43ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.971736:0:19498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9e00/0xbead52e175fc43ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.971751:0:19498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc43b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.971759:0:19498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc43b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.971766:0:19498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc43b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869843.971918:0:19498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788869843.972023:0:19498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9e00/0xbead52e175fc43ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.972032:0:19498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9e00/0xbead52e175fc43ab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.972040:0:19498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9e00/0xbead52e175fc43ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.972046:0:19498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a9e00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869843.972051:0:19498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9e00/0xbead52e175fc43ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.972059:0:19498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9e00/0xbead52e175fc43ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.972085:0:19498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fe831e6e00) 00010000:00010000:1.0:1788869843.972088:0:19498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869843.972095:0:19498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9e00/0xbead52e175fc43ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.972101:0:19498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9e00/0xbead52e175fc43ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.972116:0:19498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc43b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.972123:0:19498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc43b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.972129:0:19498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc43b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.972135:0:19498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a8c00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869843.972138:0:19498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc43b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.972143:0:19498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc43b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.972150:0:19498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99fe81f9b300) 00010000:00010000:1.0:1788869843.972152:0:19498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869843.972155:0:19498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc43b2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.972161:0:19498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc43b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.972230:0:19498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc43a4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaef3 expref: 12 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.972472:0:19498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fe831e6e00) 00010000:00010000:1.0:1788869843.972476:0:19498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869843.972481:0:19498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc43a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaef3 expref: 12 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.972494:0:19498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a9200, rc 0) 00000100:00100000:1.0:1788869843.972627:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:31cd0bfc-dd3a-4c19-9441-01049d848740+11:15592:x1875765545270656:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1404us (1877us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788869843.972637:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:2.0:1788869843.982545:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869843.982751:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545270784 00000100:00100000:1.0:1788869843.982765:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545270784 00000100:00100000:1.0:1788869843.982875:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:1.0:1788869843.982889:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31cd0bfc-dd3a-4c19-9441-01049d848740+11:15592:x1875765545270784:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1788869843.982923:0:17161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869843.982950:0:17161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc43c0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaefa expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.983137:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc43c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.983156:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc43c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.983170:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc43c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869843.983233:0:17161:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788869843.983237:0:17161:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869843.983302:0:17161:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc43c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.983335:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc43c0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaefa expref: 13 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.983357:0:17161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc43c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaefa expref: 12 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869843.983368:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99fe81f9b400) 00010000:00010000:1.0:1788869843.983371:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869843.983375:0:17161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a8c00, rc 0) 00000100:00100000:1.0:1788869843.983461:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31cd0bfc-dd3a-4c19-9441-01049d848740+12:15592:x1875765545270784:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 575us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869843.983647:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:1.0:1788869844.007373:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869844.007491:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545270912 00000100:00100000:0.0:1788869844.007509:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545270912 00000100:00100000:0.0:1788869844.007606:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:0.0:1788869844.007621:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31cd0bfc-dd3a-4c19-9441-01049d848740+12:15592:x1875765545270912:12345-192.168.201.30@tcp:37:lfs.0 00000100:00100000:2.0:1788869844.018416:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31cd0bfc-dd3a-4c19-9441-01049d848740+12:15592:x1875765545270912:12345-192.168.201.30@tcp:37:lfs.0 Request processed in 10332us (10586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869844.018448:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:2.0:1788869844.022978:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869844.024486:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545271168 00000100:00100000:3.0:1788869844.024501:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545271168 00000100:00100000:2.0:1788869844.024733:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:2.0:1788869844.024746:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8a5ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31cd0bfc-dd3a-4c19-9441-01049d848740+12:15592:x1875765545271168:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1788869844.024998:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8a5ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31cd0bfc-dd3a-4c19-9441-01049d848740+13:15592:x1875765545271168:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 254us (2031us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788869844.025006:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00000040:00080000:2.0:1788869844.057870:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788869844.075031:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869844.075093:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869844.075122:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869844.075161:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869844.075206:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869844.075222:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545271552 00000100:00100000:2.0:1788869844.075236:0:19213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545271552 00000100:00100000:2.0:1788869844.075329:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545271808 00000100:00100000:2.0:1788869844.075333:0:19213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545271808 00000100:00100000:2.0:1788869844.075351:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545271680 00000100:00100000:2.0:1788869844.075354:0:19213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545271680 00000100:00100000:2.0:1788869844.075373:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:2.0:1788869844.075389:0:19213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+5:2390:x1875765545271552:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869844.075436:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545271296 00000100:00100000:0.0:1788869844.075446:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545271296 00000100:00100000:2.0:1788869844.075500:0:19213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+5:2390:x1875765545271552:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 109us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869844.075508:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:0.0:1788869844.075529:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 164 00000100:00100000:2.0:1788869844.075548:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:2.0:1788869844.075558:0:19213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31cd0bfc-dd3a-4c19-9441-01049d848740+5:2390:x1875765545271808:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869844.075579:0:19213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31cd0bfc-dd3a-4c19-9441-01049d848740+5:2390:x1875765545271808:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869844.075585:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:2.0:1788869844.075595:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:2.0:1788869844.075601:0:19213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+5:2390:x1875765545271680:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869844.075620:0:19213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+5:2390:x1875765545271680:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 20us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869844.075624:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:0.0:1788869844.075670:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:2390:x1875765545271296:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869844.075735:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:2390:x1875765545271296:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 196us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869844.075744:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 164 00000100:00080000:3.0:1788869844.075801:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869844.075807:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869844.075837:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545271424 00000100:00100000:0.0:1788869844.075843:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545271424 00000100:00100000:0.0:1788869844.075898:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:0.0:1788869844.075907:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+5:2390:x1875765545271424:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869844.075966:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+5:2390:x1875765545271424:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 59us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869844.075974:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:1.0:1788869844.076139:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869844.078143:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545271936 00000100:00100000:0.0:1788869844.078190:0:19213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545271936 00000100:00100000:0.0:1788869844.078358:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:0.0:1788869844.078372:0:19213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31cd0bfc-dd3a-4c19-9441-01049d848740+5:2390:x1875765545271936:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:3.0:1788869844.078582:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869844.079057:0:19213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31cd0bfc-dd3a-4c19-9441-01049d848740+5:2390:x1875765545271936:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 685us (2914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869844.079068:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:1.0:1788869844.115496:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869844.115596:0:19498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545272064 00000100:00100000:3.0:1788869844.115606:0:19498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545272064 00000100:00100000:3.0:1788869844.115671:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:3.0:1788869844.115684:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+11:15598:x1875765545272064:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1788869844.115706:0:19498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869844.115729:0:19498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc43ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaf01 expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.115797:0:19498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc43d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.115812:0:19498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc43d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.115826:0:19498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc43d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.115860:0:19498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc43dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.115867:0:19498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc43dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.115874:0:19498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc43dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.115962:0:19498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535800/0xbead52e175fc43e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.115972:0:19498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535800/0xbead52e175fc43e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.117375:0:19498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535800/0xbead52e175fc43e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869844.117416:0:19498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788869844.117420:0:19498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869844.117453:0:19498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535800/0xbead52e175fc43e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.117462:0:19498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc43d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.117467:0:19498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc43d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.117471:0:19498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc43d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.117489:0:19498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869844.117492:0:19498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc43d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.117497:0:19498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc43d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.117507:0:19498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fe831e6e00) 00010000:00010000:3.0:1788869844.117509:0:19498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869844.117512:0:19498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc43d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.117516:0:19498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc43d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.117529:0:19498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc43dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.117532:0:19498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc43dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.117536:0:19498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc43dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.117539:0:19498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869844.117541:0:19498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc43dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.117544:0:19498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc43dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.117554:0:19498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99fe81f9b300) 00010000:00010000:3.0:1788869844.117555:0:19498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869844.117557:0:19498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc43dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.117560:0:19498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc43dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.117586:0:19498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc43ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf01 expref: 13 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.117595:0:19498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535800/0xbead52e175fc43e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf01 expref: 12 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.117600:0:19498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99fe81f9b400) 00010000:00010000:3.0:1788869844.117601:0:19498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788869844.117603:0:19498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81535800, rc 0) 00000100:00100000:3.0:1788869844.117666:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+12:15598:x1875765545272064:12345-192.168.201.30@tcp:101:bash.0 Request processed in 1984us (2180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869844.117680:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:1.0:1788869844.124471:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869844.124771:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545272192 00000100:00100000:0.0:1788869844.124782:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545272192 00000100:00100000:0.0:1788869844.124843:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:0.0:1788869844.124854:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+5:15598:x1875765545272192:12345-192.168.201.30@tcp:900:bash.0 00000100:00100000:0.0:1788869844.124983:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+5:15598:x1875765545272192:12345-192.168.201.30@tcp:900:bash.0 Request processed in 123us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869844.124992:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:3.0:1788869844.128452:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869844.128588:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545272448 00000100:00100000:1.0:1788869844.128612:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545272448 00000100:00100000:1.0:1788869844.128680:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:1.0:1788869844.128690:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+12:15598:x1875765545272448:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:1.0:1788869844.128710:0:17161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869844.128731:0:17161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9e00/0xbead52e175fc43ea lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaf08 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.128837:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc43f1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.128852:0:17161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc43c7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaefa expref: 12 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.128862:0:17161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc43f1 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.128898:0:17161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc43c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaefa expref: 12 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.128911:0:17161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc43c7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaefa expref: 12 pid: 17161 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869844.128924:0:17161:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb46300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17161:1875765554785280:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788869844.129142:0:17161:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb88c3480 going to sleep for 11 seconds 00000100:00100000:1.0:1788869844.132517:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869844.132619:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545272576 00000100:00100000:0.0:1788869844.132631:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545272576 00010000:00010000:0.0:1788869844.132675:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc43c7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaefa expref: 13 pid: 17161 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869844.132721:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:0.0:1788869844.132732:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31cd0bfc-dd3a-4c19-9441-01049d848740+13:2387:x1875765545272576:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869844.132747:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869844.132754:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc43c7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaefa expref: 13 pid: 17161 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869844.132768:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc43c7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaefa expref: 13 pid: 17161 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869844.132812:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99fe81f9b400) 00010000:00010000:0.0:1788869844.132817:0:17145:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc43f1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869844.132828:0:17145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc43f1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869844.132837:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc43f1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869844.132856:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869844.132917:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31cd0bfc-dd3a-4c19-9441-01049d848740+13:2387:x1875765545272576:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 186us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869844.132925:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00010000:00010000:2.0:1788869844.133382:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc43c7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaefa expref: 12 pid: 17161 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869844.133403:0:17161:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb46300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17161:1875765554785280:192.168.201.30@tcp:104: 00010000:00010000:2.0:1788869844.133428:0:17161:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc43f1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.133437:0:17161:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc43f1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.133442:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc43f1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.133478:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc43f8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.133488:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc43f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.133496:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc43f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.134161:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc43ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.134185:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc43ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.134194:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc43ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869844.134207:0:17161:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788869844.134239:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc43f1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.134246:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc43f1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.134315:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc43f1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.134322:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a9200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869844.134326:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc43f1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.134345:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc43f1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.134357:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99fe81f9b400) 00010000:00010000:2.0:1788869844.134360:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869844.134365:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc43f1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.134371:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc43f1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869844.134383:0:17161:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f0af424e reply state 0000000072382e5e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc43f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.134392:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc43f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.134398:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff99ffb89e0c00) 00010000:00010000:2.0:1788869844.134401:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788869844.134404:0:17161:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788869844.134440:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9e00/0xbead52e175fc43ea lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf08 expref: 15 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.134455:0:17161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc43ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf08 expref: 14 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.134462:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:2.0:1788869844.134464:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788869844.134466:0:17161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c1a00, rc 0) 00000100:00100000:2.0:1788869844.134532:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+15:15598:x1875765545272448:12345-192.168.201.30@tcp:101:bash.0 Request processed in 5843us (6088us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788869844.134540:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:1.0:1788869844.166524:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869844.166634:0:19497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545272704 00000100:00100000:2.0:1788869844.166644:0:19497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545272704 00000100:00100000:2.0:1788869844.166708:0:19497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:2.0:1788869844.166719:0:19497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+15:15598:x1875765545272704:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1788869844.166743:0:19497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869844.166767:0:19497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1200/0xbead52e175fc440d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaf0f expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.166836:0:19497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc4414 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.166850:0:19497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc4414 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.166860:0:19497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc4414 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869844.166906:0:19497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788869844.166910:0:19497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869844.166929:0:19497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc4414 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.166938:0:19497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc4414 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.166963:0:19497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1200/0xbead52e175fc440d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf0f expref: 17 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.167014:0:19497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc4414 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf0f expref: 16 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.167022:0:19497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:2.0:1788869844.167025:0:19497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869844.167028:0:19497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99fe823c0a00, rc 0) 00000100:00100000:2.0:1788869844.167153:0:19497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+16:15598:x1875765545272704:12345-192.168.201.30@tcp:101:bash.0 Request processed in 436us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869844.167161:0:19497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:1.0:1788869844.171530:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869844.171627:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545272960 00000100:00100000:0.0:1788869844.171638:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545272960 00000100:00100000:0.0:1788869844.171700:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:0.0:1788869844.171711:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+16:15598:x1875765545272960:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:0.0:1788869844.172005:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+17:15598:x1875765545272960:12345-192.168.201.30@tcp:35:bash.0 Request processed in 295us (483us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788869844.172012:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000040:00080000:2.0:1788869844.184730:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788869844.230919:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869844.231302:0:19498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545273216 00000100:00100000:3.0:1788869844.231312:0:19498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545273216 00000100:00100000:3.0:1788869844.232277:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:3.0:1788869844.232293:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+17:15608:x1875765545273216:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1788869844.232338:0:19498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869844.232362:0:19498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc441b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaf16 expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869844.232468:0:19498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788869844.232558:0:19498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc441b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf16 expref: 19 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.232573:0:19498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fe831e6e00) 00010000:00010000:3.0:1788869844.232575:0:19498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788869844.232580:0:19498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc441b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf16 expref: 19 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869844.232593:0:19498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534000, rc 0) 00000100:00100000:3.0:1788869844.232659:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+18:15608:x1875765545273216:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 370us (1755us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788869844.232666:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:1.0:1788869844.236130:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869844.243644:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545273472 00000100:00100000:0.0:1788869844.243663:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545273472 00000100:00100000:0.0:1788869844.243807:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:0.0:1788869844.243820:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+18:15608:x1875765545273472:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1788869844.244068:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+19:15608:x1875765545273472:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 250us (7948us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788869844.244091:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:1.0:1788869844.292372:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869844.292625:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545273728 00000100:00100000:2.0:1788869844.292634:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545273728 00000100:00100000:2.0:1788869844.292698:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:2.0:1788869844.292707:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+19:15611:x1875765545273728:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1788869844.292730:0:17161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869844.292750:0:17161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1200/0xbead52e175fc4429 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaf1d expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.292945:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2600/0xbead52e175fc4430 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.292961:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2600/0xbead52e175fc4430 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.292973:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2600/0xbead52e175fc4430 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869844.292996:0:17161:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788869844.293092:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1200/0xbead52e175fc4429 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf1d expref: 22 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.293110:0:17161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2600/0xbead52e175fc4430 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf1d expref: 21 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.293118:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:2.0:1788869844.293121:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869844.293124:0:17161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffba9f2600, rc 0) 00000100:00100000:2.0:1788869844.293222:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+21:15611:x1875765545273728:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 516us (861us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788869844.293230:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:3.0:1788869844.299404:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869844.299651:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545273856 00000100:00100000:2.0:1788869844.299662:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545273856 00000100:00100000:2.0:1788869844.299726:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:2.0:1788869844.299736:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+21:15611:x1875765545273856:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:2.0:1788869844.299803:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2800/0xbead52e175fc443e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.299820:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2800/0xbead52e175fc443e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.299832:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2800/0xbead52e175fc443e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.299945:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2800/0xbead52e175fc443e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.299967:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2800/0xbead52e175fc443e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.299973:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2800/0xbead52e175fc443e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.299980:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffba9f2800 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869844.299984:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2800/0xbead52e175fc443e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.299992:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2800/0xbead52e175fc443e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.300005:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:2.0:1788869844.300009:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788869844.300013:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2800/0xbead52e175fc443e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869844.300021:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2800/0xbead52e175fc443e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869844.300101:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+21:15611:x1875765545273856:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 366us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869844.300109:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:3.0:1788869844.300743:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869844.300878:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545273984 00000100:00100000:1.0:1788869844.300885:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545273984 00000100:00100000:1.0:1788869844.300946:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:1.0:1788869844.300955:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+21:2390:x1875765545273984:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869844.300968:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869844.300996:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2600/0xbead52e175fc4430 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf1d expref: 21 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.301010:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:1.0:1788869844.301014:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869844.301052:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+20:2390:x1875765545273984:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 97us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869844.301059:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:1.0:1788869844.304386:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869844.304505:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545274240 00000100:00100000:2.0:1788869844.304515:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545274240 00000100:00100000:2.0:1788869844.304565:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:2.0:1788869844.304576:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+20:15611:x1875765545274240:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1788869844.304796:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+21:15611:x1875765545274240:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 221us (416us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788869844.304817:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:3.0:1788869844.693467:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869844.694219:0:19498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545274496 00000100:00100000:1.0:1788869844.694231:0:19498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545274496 00000100:00100000:1.0:1788869844.694338:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:1.0:1788869844.694348:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+21:15642:x1875765545274496:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:1.0:1788869844.694373:0:19498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869844.694396:0:19498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8000/0xbead52e175fc4445 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaf24 expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.694514:0:19498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc444c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.694529:0:19498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc444c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.694557:0:19498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc444c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869844.694570:0:19498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788869844.694701:0:19498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8000/0xbead52e175fc4445 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf24 expref: 24 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.694717:0:19498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc444c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf24 expref: 23 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.694724:0:19498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:1.0:1788869844.694726:0:19498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869844.694728:0:19498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a8400, rc 0) 00000100:00100000:1.0:1788869844.694793:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+23:15642:x1875765545274496:12345-192.168.201.30@tcp:101:cat.0 Request processed in 447us (1336us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788869844.694798:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:3.0:1788869844.700480:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869844.700633:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545274624 00000100:00100000:0.0:1788869844.700646:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545274624 00000100:00100000:0.0:1788869844.700727:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:0.0:1788869844.700739:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+23:2389:x1875765545274624:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869844.700759:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869844.700790:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc444c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf24 expref: 23 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869844.700810:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:0.0:1788869844.700815:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869844.700881:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+22:2389:x1875765545274624:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 144us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869844.700891:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:3.0:1788869844.705722:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869844.705924:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545274880 00000100:00100000:2.0:1788869844.705935:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545274880 00000100:00100000:2.0:1788869844.706005:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:2.0:1788869844.706015:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+22:15642:x1875765545274880:12345-192.168.201.30@tcp:35:cat.0 00000100:00100000:2.0:1788869844.706615:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+23:15642:x1875765545274880:12345-192.168.201.30@tcp:35:cat.0 Request processed in 599us (911us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788869844.706625:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00010000:00010000:1.0:1788869844.824764:0:19701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869844.833135:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869844.833599:0:19497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545275136 00000100:00100000:1.0:1788869844.833613:0:19497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545275136 00000100:00100000:1.0:1788869844.833692:0:19497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:1.0:1788869844.833703:0:19497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+23:15648:x1875765545275136:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:1.0:1788869844.833728:0:19497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869844.833752:0:19497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8000/0xbead52e175fc445a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaf2b expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.833867:0:19497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc4461 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.833903:0:19497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc4461 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.833914:0:19497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc4461 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869844.833938:0:19497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788869844.834088:0:19497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8000/0xbead52e175fc445a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf2b expref: 26 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.834109:0:19497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc4461 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf2b expref: 25 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.834118:0:19497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:1.0:1788869844.834121:0:19497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869844.834124:0:19497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a9000, rc 0) 00000100:00100000:1.0:1788869844.834208:0:19497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+25:15648:x1875765545275136:12345-192.168.201.30@tcp:101:dd.0 Request processed in 507us (1082us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788869844.834216:0:19497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:3.0:1788869844.842724:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869844.842818:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869844.843778:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545275264 00000100:00100000:0.0:1788869844.843789:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545275264 00000100:00100000:0.0:1788869844.843856:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:0.0:1788869844.843867:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+25:15648:x1875765545275264:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1788869844.843894:0:17160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869844.843917:0:17160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05e00/0xbead52e175fc446f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaf32 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869844.843953:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc4476 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869844.843966:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc4476 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869844.844003:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc4476 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869844.844132:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05e00/0xbead52e175fc446f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf32 expref: 27 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869844.844167:0:17160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc4476 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf32 expref: 26 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869844.844177:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:0.0:1788869844.844180:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788869844.844184:0:17160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffbfb05200, rc 0) 00000100:00100000:0.0:1788869844.844244:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+26:15648:x1875765545275264:12345-192.168.201.30@tcp:101:dd.0 Request processed in 379us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869844.844296:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:3.0:1788869844.847093:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869844.847211:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545275648 00000100:00100000:1.0:1788869844.847220:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545275648 00000100:00100000:1.0:1788869844.847315:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:1.0:1788869844.847326:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+26:15648:x1875765545275648:12345-192.168.201.30@tcp:36:dd.0 00010000:00010000:1.0:1788869844.847386:0:17161:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869844.847415:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0a00/0xbead52e175fc4414 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf0f expref: 26 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.847452:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:1.0:1788869844.847457:0:17161:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869844.847635:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8000/0xbead52e175fc447d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.847650:0:17161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc4461 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf2b expref: 26 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.847658:0:17161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8000/0xbead52e175fc447d lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.847693:0:17161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc4461 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf2b expref: 26 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.847705:0:17161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc4461 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf2b expref: 26 pid: 19497 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869844.847721:0:17161:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17161:1875765554785408:192.168.201.30@tcp:104: 00000100:00100000:1.0:1788869844.847807:0:17161:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb88c3cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1788869844.852377:0:17161:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.30@tcp) returned -22 from blocking AST (req@00000000e1cb07c8 x1875765554785408) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc4461 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf2b expref: 26 pid: 19497 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.852404:0:17161:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc4461 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf2b expref: 26 pid: 19497 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.852429:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc4461 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf2b expref: 26 pid: 19497 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869844.852460:0:17161:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17161:1875765554785408:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788869844.852484:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:1.0:1788869844.852490:0:17161:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8000/0xbead52e175fc447d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.852501:0:17161:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8000/0xbead52e175fc447d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.852509:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8000/0xbead52e175fc447d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.852530:0:17161:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8000/0xbead52e175fc447d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.852538:0:17161:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8000/0xbead52e175fc447d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.852545:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8000/0xbead52e175fc447d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788869844.852640:0:17161:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788869844.852689:0:17161:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008ac2ceaf reply state 00000000f774160f transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8000/0xbead52e175fc447d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.852700:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8000/0xbead52e175fc447d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869844.852705:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:1.0:1788869844.852707:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788869844.852716:0:17161:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869844.852924:0:18314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545275392 00000100:00100000:2.0:1788869844.852932:0:18314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545275392 00000100:00100000:1.0:1788869844.853044:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+28:15648:x1875765545275648:12345-192.168.201.30@tcp:36:dd.0 Request processed in 5720us (5959us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788869844.853053:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 45 00000020:00080000:1.0:1788869844.853059:0:17161:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788869844.853517:0:18314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:2.0:1788869844.853530:0:18314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82229180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+27:2390:x1875765545275392:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869844.853547:0:18314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869844.853550:0:18314:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie bead52e175fc4461) 00010000:00010000:2.0:1788869844.853552:0:18314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869844.853580:0:18314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82229180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+27:2390:x1875765545275392:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 54us (10761us total) trans 0 rc 116/116 00000100:00100000:2.0:1788869844.853586:0:18314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:2.0:1788869844.888657:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554785536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869844.888735:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869844.888846:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554785536 00000100:00100000:0.0:1788869844.888864:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554785536 00000100:00100000:0.0:1788869844.888919:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788869844.888928:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554785536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788869844.888974:0:17165:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788869844.889034:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554785536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869844.889041:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788869844.889289:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554785536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869844.889776:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869844.889789:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554785664:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869844.889830:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869844.890411:0:17901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554785664 00000100:00100000:0.0:1788869844.890418:0:17901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554785664 00000100:00100000:0.0:1788869844.890464:0:17901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788869844.890473:0:17901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554785664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869844.890515:0:17901:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788869844.890571:0:17901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554785664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869844.890578:0:17901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788869844.890661:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554785664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869845.029734:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869845.030165:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545275904 00000100:00100000:2.0:1788869845.030176:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545275904 00000100:00100000:0.0:1788869845.030533:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:0.0:1788869845.030547:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+27:15648:x1875765545275904:12345-192.168.201.30@tcp:35:dd.0 00000100:00100000:0.0:1788869845.030803:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+28:15648:x1875765545275904:12345-192.168.201.30@tcp:35:dd.0 Request processed in 259us (1079us total) trans 8589934611 rc 0/0 00000100:00100000:0.0:1788869845.030811:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00080000:3.0:1788869845.031214:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1788869845.080928:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788869845.281144:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869845.282226:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545276032 00000100:00100000:2.0:1788869845.282239:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545276032 00000100:00100000:2.0:1788869845.282352:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:2.0:1788869845.282363:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+28:15662:x1875765545276032:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:2.0:1788869845.282387:0:17162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869845.282409:0:17162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2800/0xbead52e175fc4484 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaf39 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282475:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2e00/0xbead52e175fc448b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282490:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2e00/0xbead52e175fc448b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282503:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2e00/0xbead52e175fc448b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282513:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3600/0xbead52e175fc4492 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282520:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3600/0xbead52e175fc4492 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282526:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3600/0xbead52e175fc4492 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282594:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2200/0xbead52e175fc4499 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282602:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2200/0xbead52e175fc4499 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282628:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2200/0xbead52e175fc4499 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869845.282671:0:17162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788869845.282675:0:17162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869845.282712:0:17162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2200/0xbead52e175fc4499 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282723:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2200/0xbead52e175fc4499 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282731:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2e00/0xbead52e175fc448b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282738:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2e00/0xbead52e175fc448b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282744:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2e00/0xbead52e175fc448b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282749:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffba9f2e00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869845.282753:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2e00/0xbead52e175fc448b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282760:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2e00/0xbead52e175fc448b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282771:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99fe81f9b400) 00010000:00010000:2.0:1788869845.282775:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869845.282779:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2e00/0xbead52e175fc448b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282803:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2e00/0xbead52e175fc448b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282814:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3600/0xbead52e175fc4492 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282817:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3600/0xbead52e175fc4492 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282821:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3600/0xbead52e175fc4492 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282824:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffba9f3600 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869845.282825:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3600/0xbead52e175fc4492 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282829:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3600/0xbead52e175fc4492 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282833:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff99ffb89e0c00) 00010000:00010000:2.0:1788869845.282835:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869845.282836:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3600/0xbead52e175fc4492 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282839:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3600/0xbead52e175fc4492 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282865:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2800/0xbead52e175fc4484 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf39 expref: 30 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282883:0:17162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2200/0xbead52e175fc4499 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf39 expref: 29 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.282888:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:2.0:1788869845.282889:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869845.282891:0:17162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffba9f2200, rc 0) 00000100:00100000:2.0:1788869845.282956:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+29:15662:x1875765545276032:12345-192.168.201.30@tcp:101:stat.0 Request processed in 594us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869845.282963:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:1.0:1788869845.392411:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869845.392627:0:19498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545276288 00000100:00100000:3.0:1788869845.392640:0:19498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545276288 00000100:00100000:3.0:1788869845.392718:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:3.0:1788869845.392731:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+29:15668:x1875765545276288:12345-192.168.201.30@tcp:36:truncate.0 00010000:00010000:3.0:1788869845.392787:0:19498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869845.392819:0:19498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2200/0xbead52e175fc4499 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf39 expref: 29 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.392839:0:19498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:3.0:1788869845.392844:0:19498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869845.393226:0:19498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc44a0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.393242:0:19498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc44a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.393379:0:19498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc44a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788869845.393429:0:19498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1788869845.393452:0:19498:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e1cb07c8 reply state 00000000f6b1f2be transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc44a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.393465:0:19498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc44a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.393471:0:19498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:3.0:1788869845.393474:0:19498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788869845.393476:0:19498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788869845.393593:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+31:15668:x1875765545276288:12345-192.168.201.30@tcp:36:truncate.0 Request processed in 864us (1191us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788869845.393613:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 47 00000020:00080000:3.0:1788869845.393619:0:19498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788869845.557670:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869845.557785:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545276416 00000100:00100000:1.0:1788869845.557796:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545276416 00000100:00100000:1.0:1788869845.557882:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:1.0:1788869845.557893:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+31:15682:x1875765545276416:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:1.0:1788869845.557920:0:17161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869845.557944:0:17161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc44a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaf40 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558019:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc44ae lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558035:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc44ae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558047:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc44ae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558059:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8600/0xbead52e175fc44b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558065:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8600/0xbead52e175fc44b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558071:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8600/0xbead52e175fc44b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558180:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8e00/0xbead52e175fc44bc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558189:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8e00/0xbead52e175fc44bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558197:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8e00/0xbead52e175fc44bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869845.558239:0:17161:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1788869845.558243:0:17161:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869845.558318:0:17161:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8e00/0xbead52e175fc44bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558331:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8e00/0xbead52e175fc44bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558348:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc44ae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558354:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc44ae lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558360:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc44ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558367:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a8400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869845.558371:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc44ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558379:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc44ae lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558399:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99fe81f9b400) 00010000:00010000:1.0:1788869845.558402:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869845.558408:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc44ae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558414:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8400/0xbead52e175fc44ae lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558427:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8600/0xbead52e175fc44b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558433:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8600/0xbead52e175fc44b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558439:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8600/0xbead52e175fc44b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558444:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a8600 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869845.558448:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8600/0xbead52e175fc44b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558454:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8600/0xbead52e175fc44b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558461:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff99ffb89e0c00) 00010000:00010000:1.0:1788869845.558464:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869845.558467:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8600/0xbead52e175fc44b5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558473:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8600/0xbead52e175fc44b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558509:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9000/0xbead52e175fc44a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf40 expref: 33 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558523:0:17161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8e00/0xbead52e175fc44bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf40 expref: 32 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.558531:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:1.0:1788869845.558533:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869845.558535:0:17161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a8e00, rc 0) 00000100:00100000:1.0:1788869845.558607:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+32:15682:x1875765545276416:12345-192.168.201.30@tcp:101:stat.0 Request processed in 716us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869845.558614:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:2.0:1788869845.678819:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869845.679018:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545276672 00000100:00100000:0.0:1788869845.679032:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545276672 00000100:00100000:0.0:1788869845.679239:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:0.0:1788869845.679296:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+32:15692:x1875765545276672:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1788869845.679337:0:17160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869845.679367:0:17160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490e00/0xbead52e175fc44c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaf47 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869845.679514:0:17160:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788869845.679661:0:17160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490e00/0xbead52e175fc44c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf47 expref: 34 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869845.679679:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fe831e6e00) 00010000:00010000:0.0:1788869845.679683:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788869845.679688:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490e00/0xbead52e175fc44c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf47 expref: 34 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869845.679726:0:17160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81490e00, rc 0) 00000100:00100000:0.0:1788869845.679821:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+33:15692:x1875765545276672:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 571us (1017us total) trans 8589934614 rc 301/301 00000100:00100000:0.0:1788869845.679829:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:3.0:1788869845.683843:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869845.683967:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545276928 00000100:00100000:0.0:1788869845.683982:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545276928 00000100:00100000:0.0:1788869845.684119:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:0.0:1788869845.684131:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb8a59c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+33:15692:x1875765545276928:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1788869845.684458:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb8a59c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+34:15692:x1875765545276928:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 328us (627us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788869845.684466:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:1.0:1788869845.765664:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869845.765766:0:19497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545277184 00000100:00100000:3.0:1788869845.765777:0:19497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545277184 00000100:00100000:3.0:1788869845.765843:0:19497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:3.0:1788869845.765854:0:19497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+34:15698:x1875765545277184:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1788869845.765879:0:19497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869845.765898:0:19497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc44d1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaf4e expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.766020:0:19497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc44d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.766035:0:19497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc43ff lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf08 expref: 35 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.766043:0:19497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8e00/0xbead52e175fc44bc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf40 expref: 35 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.766052:0:19497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc44d8 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.766086:0:19497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8e00/0xbead52e175fc44bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf40 expref: 35 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.766099:0:19497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8e00/0xbead52e175fc44bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf40 expref: 35 pid: 17161 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869845.766136:0:19497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82228000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19497:1875765554785792:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869845.766233:0:19497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc43ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf08 expref: 35 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.766242:0:19497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc43ff lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf08 expref: 35 pid: 17161 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869845.766284:0:19497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8222b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19497:1875765554785920:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869845.766312:0:19497:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffaf01fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869845.774907:0:19497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82228000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19497:1875765554785792:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869845.775531:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869845.775618:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869845.775652:0:19497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8222b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19497:1875765554785920:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788869845.775678:0:19497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc44d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869845.775867:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545277440 00000100:00100000:0.0:1788869845.775876:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545277440 00010000:00010000:0.0:1788869845.775916:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc43ff lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf08 expref: 36 pid: 17161 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869845.775973:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545277312 00000100:00100000:0.0:1788869845.775977:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545277312 00010000:00010000:0.0:1788869845.775991:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8e00/0xbead52e175fc44bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf40 expref: 37 pid: 17161 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869845.776021:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:0.0:1788869845.776030:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+37:2387:x1875765545277440:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869845.776046:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869845.776054:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc43ff lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf08 expref: 37 pid: 17161 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869845.776082:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc43ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf08 expref: 37 pid: 17161 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869845.776105:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1a00/0xbead52e175fc43ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf08 expref: 37 pid: 17161 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869845.776297:0:18314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:2.0:1788869845.776307:0:18314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82228a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+36:2387:x1875765545277312:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869845.776316:0:18314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869845.776322:0:18314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8e00/0xbead52e175fc44bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf40 expref: 36 pid: 17161 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869845.776429:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:0.0:1788869845.776436:0:17145:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc44d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869845.776446:0:17145:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc44d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869845.776454:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869845.776509:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+36:2387:x1875765545277440:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 479us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869845.776518:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00010000:00010000:2.0:1788869845.778204:0:18314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8e00/0xbead52e175fc44bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf40 expref: 35 pid: 17161 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.778239:0:18314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8e00/0xbead52e175fc44bc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf40 expref: 35 pid: 17161 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.778366:0:18314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:2.0:1788869845.778373:0:18314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc44d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.778405:0:18314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc44d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.778413:0:18314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc44d8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.778571:0:18314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869845.778641:0:18314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82228a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+34:2387:x1875765545277312:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 2333us (3020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869845.778650:0:18314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00010000:00010000:3.0:1788869845.780537:0:19497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc44d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.780553:0:19497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc44d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869845.780575:0:19497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1788869845.780723:0:19497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc44d1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf4e expref: 35 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.780743:0:19497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc44d8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf4e expref: 34 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.780750:0:19497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:3.0:1788869845.780753:0:19497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788869845.780767:0:19497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534a00, rc 0) 00000100:00100000:3.0:1788869845.780877:0:19497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+34:15698:x1875765545277184:12345-192.168.201.30@tcp:101:bash.0 Request processed in 15023us (15222us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1788869845.780887:0:19497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:0.0:1788869845.785824:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869845.785917:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545277696 00000100:00100000:1.0:1788869845.786064:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545277696 00000100:00100000:1.0:1788869845.786229:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:1.0:1788869845.786240:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+34:15698:x1875765545277696:12345-192.168.201.30@tcp:36:bash.0 00010000:00010000:1.0:1788869845.786526:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9c00/0xbead52e175fc44e6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.786548:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9c00/0xbead52e175fc44e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.786581:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9c00/0xbead52e175fc44e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788869845.786632:0:17161:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:1.0:1788869845.786656:0:17161:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007e3156eb reply state 000000001e2db93d transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9c00/0xbead52e175fc44e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.786670:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9c00/0xbead52e175fc44e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.786678:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:1.0:1788869845.786681:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788869845.786685:0:17161:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788869845.786791:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+37:15698:x1875765545277696:12345-192.168.201.30@tcp:36:bash.0 Request processed in 552us (978us total) trans 8589934618 rc 0/0 00000100:00100000:1.0:1788869845.786800:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 51 00000020:00080000:1.0:1788869845.786806:0:17161:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788869845.789798:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869845.789880:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545277824 00000100:00100000:0.0:1788869845.789890:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545277824 00000100:00100000:0.0:1788869845.789959:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:0.0:1788869845.789971:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+37:15698:x1875765545277824:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1788869845.789996:0:17160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869845.790016:0:17160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491200/0xbead52e175fc44ed lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaf55 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869845.790076:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491200/0xbead52e175fc44ed lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf55 expref: 38 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869845.790105:0:17160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491200/0xbead52e175fc44ed lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf55 expref: 38 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869845.790136:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:0.0:1788869845.790139:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869845.790151:0:17160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81491200, rc 0) 00000100:00100000:0.0:1788869845.790220:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+38:15698:x1875765545277824:12345-192.168.201.30@tcp:101:bash.0 Request processed in 250us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869845.790228:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:2.0:1788869845.799118:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869845.799211:0:19497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545277952 00000100:00100000:3.0:1788869845.799223:0:19497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545277952 00000100:00100000:3.0:1788869845.799328:0:19497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:3.0:1788869845.799340:0:19497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+38:15698:x1875765545277952:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1788869845.799367:0:19497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869845.799392:0:19497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535600/0xbead52e175fc44f4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaf5c expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.799510:0:19497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc44fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.799529:0:19497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc44d8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf4e expref: 39 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.799541:0:19497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc44fb lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.799585:0:19497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc44d8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf4e expref: 39 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.799600:0:19497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc44d8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf4e expref: 39 pid: 19497 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869845.799616:0:19497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82229f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19497:1875765554786048:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869845.799726:0:19497:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffaf01fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869845.802751:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869845.802895:0:19497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82229f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19497:1875765554786048:192.168.201.30@tcp:104: 00010000:00010000:1.0:1788869845.802929:0:19497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc44fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869845.803892:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545278080 00000100:00100000:0.0:1788869845.803902:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545278080 00010000:00010000:0.0:1788869845.804092:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc44d8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf4e expref: 40 pid: 19497 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869845.804268:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:0.0:1788869845.804280:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+40:2388:x1875765545278080:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869845.804296:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869845.804303:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc44d8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf4e expref: 40 pid: 19497 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869845.804318:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc44d8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf4e expref: 40 pid: 19497 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869845.804341:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc44d8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf4e expref: 40 pid: 19497 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869845.804383:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:0.0:1788869845.804388:0:17147:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc44fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869845.804400:0:17147:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc44fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869845.804409:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc44fb lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869845.804443:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869845.804499:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+39:2388:x1875765545278080:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 221us (1759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869845.804508:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00010000:00010000:3.0:1788869845.804894:0:19497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc44fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.804905:0:19497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc44fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869845.804982:0:19497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788869845.804987:0:19497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869845.805007:0:19497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc44fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.805037:0:19497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535600/0xbead52e175fc44f4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf5c expref: 39 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.805054:0:19497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc44fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf5c expref: 38 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869845.805062:0:19497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:3.0:1788869845.805065:0:19497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788869845.805067:0:19497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534200, rc 0) 00000100:00100000:3.0:1788869845.805107:0:19497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+38:15698:x1875765545277952:12345-192.168.201.30@tcp:101:bash.0 Request processed in 5769us (5999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869845.805116:0:19497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:3.0:1788869845.809294:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869845.809659:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545278336 00000100:00100000:1.0:1788869845.809671:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545278336 00000100:00100000:1.0:1788869845.809744:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:1.0:1788869845.809754:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+38:15698:x1875765545278336:12345-192.168.201.30@tcp:103:bash.0 00010000:00010000:1.0:1788869845.809771:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788869845.809806:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491200/0xbead52e175fc44ed lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf55 expref: 38 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.809862:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc44fb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf5c expref: 37 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869845.809877:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:1.0:1788869845.809882:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869845.809940:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+36:15698:x1875765545278336:12345-192.168.201.30@tcp:103:bash.0 Request processed in 187us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869845.809961:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:3.0:1788869845.812791:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869845.812874:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545278464 00000100:00100000:0.0:1788869845.812885:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545278464 00000100:00100000:0.0:1788869845.812952:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:0.0:1788869845.812964:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+36:15698:x1875765545278464:12345-192.168.201.30@tcp:58:bash.0 00010000:00010000:0.0:1788869845.813101:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491400/0xbead52e175fc4502 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869845.813119:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491400/0xbead52e175fc4502 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869845.813152:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491400/0xbead52e175fc4502 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788869845.815078:0:17160:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869845.815516:0:17160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788869845.815635:0:17160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788869845.815772:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+36:15698:x1875765545278464:12345-192.168.201.30@tcp:58:bash.0 Request processed in 2803us (2984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869845.815785:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:3.0:1788869845.820242:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869845.820600:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545278592 00000100:00100000:2.0:1788869845.820613:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545278592 00000100:00100000:2.0:1788869845.820719:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:2.0:1788869845.820731:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8222b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+36:15698:x1875765545278592:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1788869845.820755:0:17161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869845.820782:0:17161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3a00/0xbead52e175fc4509 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaf63 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.820845:0:17161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491400/0xbead52e175fc4502 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.820857:0:17161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3a00/0xbead52e175fc4509 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf63 expref: 37 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.820876:0:17161:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491400/0xbead52e175fc4502 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.820910:0:17161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3a00/0xbead52e175fc4509 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf63 expref: 37 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.820925:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:2.0:1788869845.820928:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788869845.820932:0:17161:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3a00/0xbead52e175fc4509 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf63 expref: 37 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869845.820941:0:17161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffba9f3a00, rc 0) 00000100:00100000:2.0:1788869845.821015:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8222b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+37:15698:x1875765545278592:12345-192.168.201.30@tcp:101:bash.0 Request processed in 286us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869845.821022:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 55 00010000:00010000:2.0:1788869845.848480:0:19700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869846.232580:0:17196:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788869846.232592:0:17196:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869846.232623:0:17196:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788869846.232634:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788869846.232777:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe84041180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17196:1875765554786176:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788869846.234152:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffae5fe540 going to sleep for 11 seconds 00000100:00100000:3.0:1788869846.247672:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869846.247861:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe84041180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17196:1875765554786176:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788869846.248510:0:19497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545278720 00000100:00100000:1.0:1788869846.248519:0:19497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545278720 00000100:00100000:1.0:1788869846.248624:0:19497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:1.0:1788869846.248636:0:19497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+37:15699:x1875765545278720:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788869846.248667:0:19497:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788869846.248790:0:19497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+37:15699:x1875765545278720:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 157us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869846.248798:0:19497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:0.0:1788869846.253593:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869846.254100:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545278848 00000100:00100000:2.0:1788869846.254112:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545278848 00000100:00100000:2.0:1788869846.254205:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:2.0:1788869846.254215:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+37:15699:x1875765545278848:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788869846.254681:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2400/0xbead52e175fc4510 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.254709:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2400/0xbead52e175fc4510 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.254734:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2400/0xbead52e175fc4510 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.254798:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3c00/0xbead52e175fc4517 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.254806:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3c00/0xbead52e175fc4517 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.254813:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3c00/0xbead52e175fc4517 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.254836:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3000/0xbead52e175fc451e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.254845:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3000/0xbead52e175fc451e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.254851:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3000/0xbead52e175fc451e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869846.254899:0:17160:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788869846.254904:0:17160:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869846.254921:0:17160:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3000/0xbead52e175fc451e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.254931:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2400/0xbead52e175fc4510 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.254960:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2400/0xbead52e175fc4510 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.254968:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2400/0xbead52e175fc4510 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.254974:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffba9f2400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869846.254979:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2400/0xbead52e175fc4510 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.254985:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2400/0xbead52e175fc4510 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.254998:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99fe820c1600) 00010000:00010000:2.0:1788869846.255001:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869846.255006:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2400/0xbead52e175fc4510 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.255013:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f2400/0xbead52e175fc4510 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.255026:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3c00/0xbead52e175fc4517 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.255032:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3c00/0xbead52e175fc4517 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.255039:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3c00/0xbead52e175fc4517 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.255043:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffba9f3c00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869846.255052:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3c00/0xbead52e175fc4517 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.255058:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3c00/0xbead52e175fc4517 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.255066:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff99ffb89e0e00) 00010000:00010000:2.0:1788869846.255069:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869846.255072:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3c00/0xbead52e175fc4517 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.255078:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3c00/0xbead52e175fc4517 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.255092:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3000/0xbead52e175fc451e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.255097:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3000/0xbead52e175fc451e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.255102:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3000/0xbead52e175fc451e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.255107:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffba9f3000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:2.0:1788869846.255119:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3000/0xbead52e175fc451e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.255126:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3000/0xbead52e175fc451e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.255141:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:2.0:1788869846.255144:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869846.255155:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3000/0xbead52e175fc451e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.255162:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3000/0xbead52e175fc451e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869846.255249:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+37:15699:x1875765545278848:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 Request processed in 1033us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869846.255596:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:2.0:1788869846.258886:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869846.258999:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545279104 00000100:00100000:1.0:1788869846.259008:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545279104 00000100:00100000:1.0:1788869846.259072:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:1.0:1788869846.259084:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+37:15699:x1875765545279104:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869846.259106:0:17161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869846.259143:0:17161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc4525 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaf6a expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.259292:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9600/0xbead52e175fc452c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.259321:0:17161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9600/0xbead52e175fc452c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.259332:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9600/0xbead52e175fc452c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869846.259347:0:17161:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788869846.259424:0:17161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9600/0xbead52e175fc452c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.259432:0:17161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9600/0xbead52e175fc452c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.259439:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9600/0xbead52e175fc452c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.259445:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a9600 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869846.259449:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9600/0xbead52e175fc452c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.259457:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9600/0xbead52e175fc452c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.259470:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:1.0:1788869846.259473:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869846.259478:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9600/0xbead52e175fc452c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.259485:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9600/0xbead52e175fc452c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.259534:0:17161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc4525 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf6a expref: 39 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.259551:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99fe820c1600) 00010000:00010000:1.0:1788869846.259554:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869846.259558:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8c00/0xbead52e175fc4525 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf6a expref: 39 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.259569:0:17161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a8c00, rc 0) 00000100:00100000:1.0:1788869846.259633:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+38:15699:x1875765545279104:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 551us (755us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1788869846.259640:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:3.0:1788869846.264016:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869846.264098:0:19497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545279232 00000100:00100000:1.0:1788869846.264108:0:19497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545279232 00000100:00100000:1.0:1788869846.264191:0:19497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:1.0:1788869846.264202:0:19497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+38:15699:x1875765545279232:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788869846.264239:0:19497:0:(mdt_handler.c:8041:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788869846.264398:0:19497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+38:15699:x1875765545279232:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 196us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869846.264408:0:19497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:1.0:1788869846.274584:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869846.274671:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545279488 00000100:00100000:2.0:1788869846.274680:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545279488 00000100:00100000:2.0:1788869846.274740:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:2.0:1788869846.274750:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+38:15699:x1875765545279488:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869846.274774:0:17160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869846.274795:0:17160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3000/0xbead52e175fc453a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaf71 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788869846.275226:0:17160:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:2.0:1788869846.275233:0:17160:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788869846.275698:0:17160:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:2.0:1788869846.275874:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3c00/0xbead52e175fc4541 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.275890:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3c00/0xbead52e175fc4541 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.275903:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3c00/0xbead52e175fc4541 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.276466:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3000/0xbead52e175fc453a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf71 expref: 41 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.276505:0:17160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3c00/0xbead52e175fc4541 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf71 expref: 40 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.276515:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99ffb89e0e00) 00010000:00010000:2.0:1788869846.276517:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869846.276521:0:17160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffba9f3c00, rc 0) 00000100:00100000:2.0:1788869846.276598:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+40:15699:x1875765545279488:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 1848us (2024us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788869846.276607:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:2.0:1788869846.280565:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869846.280750:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545279744 00000100:00100000:3.0:1788869846.280763:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545279744 00000100:00100000:3.0:1788869846.280830:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:3.0:1788869846.280841:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+40:15699:x1875765545279744:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788869846.280898:0:17162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869846.280942:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3c00/0xbead52e175fc4541 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf71 expref: 40 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.280962:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99ffb89e0e00) 00010000:00010000:3.0:1788869846.280971:0:17162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869846.280997:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535600/0xbead52e175fc454f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.281011:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535600/0xbead52e175fc454f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.281021:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535600/0xbead52e175fc454f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.281036:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc4556 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xff92cb49 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.281043:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc4556 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xff92cb49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.281049:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc4556 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xff92cb49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.281097:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535600/0xbead52e175fc454f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.281128:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535600/0xbead52e175fc454f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.281142:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535600/0xbead52e175fc454f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.281149:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535600 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869846.281153:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535600/0xbead52e175fc454f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.281160:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535600/0xbead52e175fc454f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.281172:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99fe81f9b400) 00010000:00010000:3.0:1788869846.281174:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869846.281177:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535600/0xbead52e175fc454f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.281183:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535600/0xbead52e175fc454f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.281195:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc4556 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xff92cb49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.281200:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc4556 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xff92cb49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.281205:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc4556 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xff92cb49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.281210:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:3.0:1788869846.281218:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc4556 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xff92cb49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.281224:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc4556 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xff92cb49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.281231:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xff92cb49 (ffff99fe820c1d00) 00010000:00010000:3.0:1788869846.281233:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869846.281236:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc4556 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xff92cb49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.281241:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534000/0xbead52e175fc4556 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xff92cb49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869846.281686:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+39:15699:x1875765545279744:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 845us (1126us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788869846.281695:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:0.0:1788869846.285048:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869846.285210:0:19498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545279872 00000100:00100000:3.0:1788869846.285221:0:19498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545279872 00000100:00100000:3.0:1788869846.285475:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:3.0:1788869846.285487:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+39:15699:x1875765545279872:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869846.285510:0:19498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869846.285533:0:19498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc455d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaf78 expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.285568:0:19498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc4564 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.285580:0:19498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc4564 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.285606:0:19498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc4564 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.285719:0:19498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc455d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf78 expref: 41 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.285738:0:19498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534a00/0xbead52e175fc4564 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf78 expref: 40 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.285745:0:19498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99fe820c1f00) 00010000:00010000:3.0:1788869846.285748:0:19498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788869846.285752:0:19498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534a00, rc 0) 00000100:00100000:3.0:1788869846.285818:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+40:15699:x1875765545279872:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 334us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869846.285826:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:2.0:1788869846.289441:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869846.289534:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545280128 00000100:00100000:0.0:1788869846.289544:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545280128 00000100:00100000:0.0:1788869846.289599:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:0.0:1788869846.289609:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+40:15699:x1875765545280128:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788869846.289691:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491a00/0xbead52e175fc456b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.289708:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491a00/0xbead52e175fc456b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.289719:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491a00/0xbead52e175fc456b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788869846.289895:0:17160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1788869846.289908:0:17160:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 464216653957ns, next at 465216649967ns, rc = 0 00000004:00010000:0.0:1788869846.289987:0:17160:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006f5f6e80 reply state 000000002c22b6c9 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491a00/0xbead52e175fc456b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.290000:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491a00/0xbead52e175fc456b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.290007:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99fe820c1f00) 00010000:00010000:0.0:1788869846.290010:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788869846.290013:0:17160:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869846.290153:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+42:15699:x1875765545280128:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 544us (902us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1788869846.290160:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:2.0:1788869846.294015:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869846.294185:0:19497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545280256 00000100:00100000:1.0:1788869846.294196:0:19497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545280256 00000100:00100000:1.0:1788869846.294546:0:19497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:1.0:1788869846.294559:0:19497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+42:15699:x1875765545280256:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869846.294588:0:19497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869846.294614:0:19497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9600/0xbead52e175fc4572 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaf7f expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.294699:0:19497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9600/0xbead52e175fc4572 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf7f expref: 43 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.294715:0:19497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9600/0xbead52e175fc4572 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf7f expref: 43 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.294732:0:19497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99fe820c1f00) 00010000:00010000:1.0:1788869846.294735:0:19497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869846.294739:0:19497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a9600, rc 0) 00000100:00100000:1.0:1788869846.294804:0:19497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+43:15699:x1875765545280256:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 248us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869846.294811:0:19497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:3.0:1788869846.298755:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869846.298829:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545280384 00000100:00100000:0.0:1788869846.298839:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545280384 00000100:00100000:0.0:1788869846.298908:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:0.0:1788869846.298919:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+5:2387:x1875765545280384:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788869846.299175:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:2387:x1875765545280384:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 257us (429us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788869846.299183:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00080000:3.0:1788869846.299877:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869846.302390:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869846.302540:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545280640 00000100:00100000:2.0:1788869846.302550:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545280640 00000100:00100000:2.0:1788869846.302615:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:2.0:1788869846.302625:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffae6ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+43:15699:x1875765545280640:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788869846.302862:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffae6ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+44:15699:x1875765545280640:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 238us (482us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788869846.302870:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:2.0:1788869846.306145:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869846.306227:0:19498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545280896 00000100:00100000:3.0:1788869846.306240:0:19498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545280896 00000100:00100000:3.0:1788869846.306330:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:3.0:1788869846.306341:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+44:15699:x1875765545280896:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788869846.306462:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+44:15699:x1875765545280896:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 123us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869846.306471:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:3.0:1788869846.310631:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869846.310757:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545281024 00000100:00100000:2.0:1788869846.310771:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545281024 00000100:00100000:2.0:1788869846.310839:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:2.0:1788869846.310849:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+44:15699:x1875765545281024:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869846.310880:0:17162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869846.310904:0:17162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3800/0xbead52e175fc4579 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaf86 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.311202:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3000/0xbead52e175fc4580 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.311217:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3000/0xbead52e175fc4580 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.311229:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3000/0xbead52e175fc4580 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869846.311421:0:17162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869846.311442:0:17162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3000/0xbead52e175fc4580 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.311468:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3800/0xbead52e175fc4579 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf86 expref: 46 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.311485:0:17162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3000/0xbead52e175fc4580 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf86 expref: 45 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.311493:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99fe820c1f00) 00010000:00010000:2.0:1788869846.311495:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788869846.311498:0:17162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffba9f3000, rc 0) 00000100:00100000:2.0:1788869846.311665:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+45:15699:x1875765545281024:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 816us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869846.311673:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:2.0:1788869846.316594:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869846.316689:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545281152 00000100:00100000:3.0:1788869846.316700:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545281152 00000100:00100000:3.0:1788869846.316814:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:3.0:1788869846.316824:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe84040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+6:2390:x1875765545281152:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869846.316844:0:18668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869846.316866:0:18668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000705a0d9f/0xbead52e175fc4587 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaf8d expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788869846.316892:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ffcd6, blocks: 0x0 00010000:00010000:3.0:1788869846.316914:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=464s v=(0 0) 00010000:00010000:3.0:1788869846.316919:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869846.316929:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000705a0d9f/0xbead52e175fc4587 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf8d expref: 7 pid: 18668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.316963:0:18668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000705a0d9f/0xbead52e175fc4587 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf8d expref: 7 pid: 18668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.316978:0:18668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81535200, rc 0) 00000100:00100000:3.0:1788869846.317034:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe84040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+7:2390:x1875765545281152:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 211us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869846.317041:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:2.0:1788869846.321227:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869846.321406:0:19497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545281408 00000100:00100000:1.0:1788869846.321418:0:19497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545281408 00000100:00100000:1.0:1788869846.321520:0:19497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:1.0:1788869846.321534:0:19497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8335ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+45:15699:x1875765545281408:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788869846.321653:0:19497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8335ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+45:15699:x1875765545281408:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 123us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869846.321660:0:19497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:3.0:1788869846.325892:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869846.326569:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545281536 00000100:00100000:2.0:1788869846.326581:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545281536 00000100:00100000:2.0:1788869846.326683:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:2.0:1788869846.326694:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+45:15699:x1875765545281536:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788869846.329552:0:17140:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:2.0:1788869846.329576:0:17140:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788869846.329649:0:17140:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1788869846.329824:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+20:15699:x1875765545281536:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 Request processed in 3124us (3936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869846.329837:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:3.0:1788869846.330216:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe8397d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554786304:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788869846.330427:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869846.330490:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554786304 00000100:00100000:3.0:1788869846.330499:0:19213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554786304 00000100:00100000:3.0:1788869846.330582:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788869846.330592:0:19213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe8397e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875765554786304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788869846.330745:0:19213:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788869846.330748:0:19213:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788869846.330750:0:19213:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788869846.330752:0:19213:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788869846 -> 1788869846 00002000:00010000:3.0:1788869846.330754:0:19213:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788869846.330787:0:19213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe8397e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3617:x1875765554786304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 197us (361us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788869846.330794:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:3.0:1788869846.330828:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99fe8397d880/2, rc 0, transno 8589934596 00000100:00100000:3.0:1788869846.330833:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe8397d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875765554786304:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1788869846.330846:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788869846.331071:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc439d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.331083:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc439d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.331091:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc439d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.331108:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c1400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869846.331124:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc439d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.331141:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc439d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.331161:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99fe81f9b400) 00010000:00010000:1.0:1788869846.331165:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788869846.331171:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc439d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.331179:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c1400/0xbead52e175fc439d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.332748:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc4349 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.332764:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc4349 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.332772:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc4349 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.332778:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff80031000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869846.332783:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc4349 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.332790:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc4349 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.332804:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99fe81f9b300) 00010000:00010000:0.0:1788869846.332807:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869846.332811:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc4349 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.332826:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff80031000/0xbead52e175fc4349 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.332848:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc4350 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.332853:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc4350 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.332859:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc4350 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.332864:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffbfb05400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869846.332867:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc4350 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.332873:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc4350 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.332881:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99fe81f9b400) 00010000:00010000:0.0:1788869846.332883:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869846.332886:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc4350 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.332892:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05400/0xbead52e175fc4350 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.332907:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc43f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.332914:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc43f8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.332929:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc43f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.332934:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99fe823c0400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869846.332937:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc43f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.332957:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc43f8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.332966:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff99ffb89e0c00) 00010000:00010000:0.0:1788869846.332969:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869846.332972:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc43f8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.332978:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99fe823c0400/0xbead52e175fc43f8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.332994:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8000/0xbead52e175fc447d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333000:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8000/0xbead52e175fc447d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333005:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8000/0xbead52e175fc447d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333011:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a8000 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869846.333013:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8000/0xbead52e175fc447d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333029:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8000/0xbead52e175fc447d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333038:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:0.0:1788869846.333040:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869846.333043:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8000/0xbead52e175fc447d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333048:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a8000/0xbead52e175fc447d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333061:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc44a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333067:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc44a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333072:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc44a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333077:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869846.333080:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc44a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333085:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc44a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333092:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:0.0:1788869846.333094:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869846.333097:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc44a0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333123:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535a00/0xbead52e175fc44a0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333146:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9c00/0xbead52e175fc44e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333152:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9c00/0xbead52e175fc44e6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333158:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9c00/0xbead52e175fc44e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333163:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a9c00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869846.333166:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9c00/0xbead52e175fc44e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333173:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9c00/0xbead52e175fc44e6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333181:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:0.0:1788869846.333183:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869846.333186:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9c00/0xbead52e175fc44e6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333192:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9c00/0xbead52e175fc44e6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17161 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333202:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491a00/0xbead52e175fc456b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333207:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491a00/0xbead52e175fc456b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333220:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491a00/0xbead52e175fc456b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333225:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81491a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869846.333227:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491a00/0xbead52e175fc456b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333233:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491a00/0xbead52e175fc456b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333242:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99fe820c1f00) 00010000:00010000:0.0:1788869846.333244:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788869846.333248:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491a00/0xbead52e175fc456b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.333448:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491a00/0xbead52e175fc456b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869846.336457:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869846.336577:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545281664 00000100:00100000:0.0:1788869846.336590:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545281664 00000100:00100000:0.0:1788869846.336653:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:0.0:1788869846.336663:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff88011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+7:2388:x1875765545281664:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788869846.336778:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff88011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+7:2388:x1875765545281664:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 Request processed in 116us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869846.336786:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:2.0:1788869846.341397:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869846.341557:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545281920 00000100:00100000:3.0:1788869846.341567:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545281920 00000100:00100000:3.0:1788869846.341688:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:3.0:1788869846.341699:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+14:15699:x1875765545281920:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788869846.341758:0:17162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869846.341789:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3000/0xbead52e175fc4580 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf86 expref: 14 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.341811:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99fe820c1f00) 00010000:00010000:3.0:1788869846.341816:0:17162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869846.341848:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535600/0xbead52e175fc458e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.341863:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535600/0xbead52e175fc458e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.341889:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535600/0xbead52e175fc458e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869846.342168:0:17162:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000059da8349 reply state 0000000018aefde7 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535600/0xbead52e175fc458e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.342180:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535600/0xbead52e175fc458e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.342185:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99fe820c1f00) 00010000:00010000:3.0:1788869846.342188:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788869846.342190:0:17162:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788869846.342466:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+15:15699:x1875765545281920:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 766us (1077us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1788869846.342474:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:2.0:1788869846.346480:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869846.346551:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545282048 00000100:00100000:3.0:1788869846.346561:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545282048 00000100:00100000:3.0:1788869846.346619:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:3.0:1788869846.346629:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffba52c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+7:15699:x1875765545282048:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788869846.346647:0:18668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869846.346666:0:18668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb1096e4/0xbead52e175fc4595 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaf94 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.346698:0:18668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000705a0d9f/0xbead52e175fc4587 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf8d expref: 8 pid: 18668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.346707:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869846.346722:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869846.346728:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb1096e4/0xbead52e175fc4595 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf94 expref: 8 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.346765:0:18668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000705a0d9f/0xbead52e175fc4587 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf8d expref: 8 pid: 18668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.346778:0:18668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000705a0d9f/0xbead52e175fc4587 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf8d expref: 8 pid: 18668 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869846.346792:0:18668:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff832e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18668:1875765554786432:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869846.346876:0:18668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffaf01f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869846.351082:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869846.351355:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545282176 00000100:00100000:1.0:1788869846.351365:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545282176 00010000:00010000:1.0:1788869846.351408:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000705a0d9f/0xbead52e175fc4587 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf8d expref: 9 pid: 18668 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869846.351449:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:1.0:1788869846.351460:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+9:2388:x1875765545282176:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869846.351477:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869846.351501:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000705a0d9f/0xbead52e175fc4587 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf8d expref: 9 pid: 18668 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.351516:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000705a0d9f/0xbead52e175fc4587 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf8d expref: 9 pid: 18668 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.351565:0:17145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869846.351569:0:17145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869846.351577:0:17145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb1096e4/0xbead52e175fc4595 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf94 expref: 9 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.351587:0:17145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb1096e4/0xbead52e175fc4595 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf94 expref: 9 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.351632:0:17145:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fb1096e4/0xbead52e175fc4595 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf94 expref: 9 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869846.351650:0:17145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb47480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17145:1875765554786560:192.168.201.30@tcp:105: 00000100:00100000:1.0:1788869846.351729:0:17145:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb88c3480 going to sleep for 11 seconds 00010000:00010000:3.0:1788869846.352470:0:18668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000705a0d9f/0xbead52e175fc4587 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf8d expref: 9 pid: 18668 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869846.352487:0:18668:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff832e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18668:1875765554786432:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869846.352510:0:18668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fb1096e4/0xbead52e175fc4595 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf94 expref: 8 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.352522:0:18668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81534000, rc 0) 00000100:00100000:3.0:1788869846.352568:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffba52c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+8:15699:x1875765545282048:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 5939us (6098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869846.352576:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:0.0:1788869846.357787:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869846.357865:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545282304 00000100:00100000:3.0:1788869846.357875:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545282304 00000100:00100000:3.0:1788869846.357960:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:3.0:1788869846.357972:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+8:2387:x1875765545282304:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788869846.358145:0:18667:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788869846.358149:0:18667:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788869846 00002000:00010000:3.0:1788869846.358151:0:18667:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788869844 00002000:00010000:3.0:1788869846.358153:0:18667:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788869846 -> 1788869846 00002000:00010000:3.0:1788869846.358156:0:18667:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788869846.358224:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+9:2387:x1875765545282304:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 255us (448us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788869846.358233:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:1.0:1788869846.358709:0:17145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb47480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17145:1875765554786560:192.168.201.30@tcp:105: 00010000:00010000:1.0:1788869846.358732:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869846.358773:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+8:2388:x1875765545282176:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 7315us (7701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869846.358782:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:0.0:1788869846.363795:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869846.363907:0:19702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545282432 00000100:00100000:1.0:1788869846.363917:0:19702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545282432 00000100:00100000:1.0:1788869846.364036:0:19702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:1.0:1788869846.364046:0:19702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+8:2390:x1875765545282432:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788869846.364094:0:19702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000713f1d30/0xbead52e175fc459c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.364128:0:19702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb1096e4/0xbead52e175fc4595 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf94 expref: 8 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.364144:0:19702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869846.364149:0:19702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788869846.364155:0:19702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713f1d30/0xbead52e175fc459c lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.364189:0:19702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb1096e4/0xbead52e175fc4595 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf94 expref: 8 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.364203:0:19702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb1096e4/0xbead52e175fc4595 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf94 expref: 8 pid: 18668 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869846.364220:0:19702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19702:1875765554786688:192.168.201.30@tcp:104: 00000100:00100000:2.0:1788869846.365173:0:19702:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb88c3480 going to sleep for 11 seconds 00000100:00100000:2.0:1788869846.370438:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869846.370662:0:19702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19702:1875765554786688:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869846.370690:0:19702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000713f1d30/0xbead52e175fc459c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869846.370749:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545282560 00000100:00100000:0.0:1788869846.370756:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545282560 00010000:00010000:0.0:1788869846.370792:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fb1096e4/0xbead52e175fc4595 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf94 expref: 9 pid: 18668 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869846.370867:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:0.0:1788869846.370877:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82327b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+9:2387:x1875765545282560:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869846.370895:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869846.370918:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb1096e4/0xbead52e175fc4595 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf94 expref: 9 pid: 18668 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.371452:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb1096e4/0xbead52e175fc4595 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf94 expref: 9 pid: 18668 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.371478:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb1096e4/0xbead52e175fc4595 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf94 expref: 9 pid: 18668 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.371496:0:17147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869846.371500:0:17147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788869846.371505:0:17147:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000713f1d30/0xbead52e175fc459c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.371517:0:17147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713f1d30/0xbead52e175fc459c lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.371548:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869846.371749:0:19702:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000713f1d30/0xbead52e175fc459c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.371759:0:19702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713f1d30/0xbead52e175fc459c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.371782:0:19702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000713f1d30/0xbead52e175fc459c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.371789:0:19702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713f1d30/0xbead52e175fc459c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.371810:0:19702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713f1d30/0xbead52e175fc459c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.371821:0:19702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a8000 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:3.0:1788869846.371826:0:19702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713f1d30/0xbead52e175fc459c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.371835:0:19702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713f1d30/0xbead52e175fc459c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.371848:0:19702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713f1d30/0xbead52e175fc459c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.371855:0:19702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713f1d30/0xbead52e175fc459c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869846.371921:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82327b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+8:2387:x1875765545282560:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1044us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869846.371945:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:3.0:1788869846.376032:0:19702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+7:2390:x1875765545282432:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 Request processed in 11968us (12230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869846.376049:0:19702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:1.0:1788869846.379752:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1788869846.380022:0:19497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545282816 00000100:00100000:3.0:1788869846.380033:0:19497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545282816 00000100:00100000:3.0:1788869846.380095:0:19497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:3.0:1788869846.380106:0:19497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+15:15699:x1875765545282816:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788869846.380213:0:19497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc45a3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.380245:0:19497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc4476 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf32 expref: 15 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.380291:0:19497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc45a3 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.380328:0:19497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc4476 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf32 expref: 15 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.380343:0:19497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc4476 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf32 expref: 15 pid: 17160 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869846.380358:0:19497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff832e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19497:1875765554786816:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869846.380430:0:19497:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffaf01f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788869846.387836:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869846.387945:0:18314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545282944 00000100:00100000:0.0:1788869846.387955:0:18314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545282944 00010000:00010000:0.0:1788869846.387997:0:18314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc4476 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf32 expref: 16 pid: 17160 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869846.388042:0:18314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:0.0:1788869846.388053:0:18314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+16:2388:x1875765545282944:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869846.388069:0:18314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869846.388076:0:18314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc4476 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf32 expref: 16 pid: 17160 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.388091:0:18314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc4476 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf32 expref: 16 pid: 17160 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.388124:0:18314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:0.0:1788869846.388139:0:18314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3a00/0xbead52e175fc4509 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf63 expref: 16 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.388151:0:18314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc45a3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.388159:0:18314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc45a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.388166:0:18314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc45a3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.388202:0:18314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869846.388295:0:18314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+16:2388:x1875765545282944:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 243us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869846.388303:0:18314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00010000:00010000:3.0:1788869846.388985:0:19497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffbfb05200/0xbead52e175fc4476 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf32 expref: 15 pid: 17160 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869846.389006:0:19497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff832e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19497:1875765554786816:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869846.389027:0:19497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc45a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.389037:0:19497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc45a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.389042:0:19497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc45a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.389460:0:19497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc45aa lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.389482:0:19497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9600/0xbead52e175fc4572 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf7f expref: 15 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.389491:0:19497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc45aa lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.389526:0:19497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9600/0xbead52e175fc4572 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf7f expref: 15 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869846.389542:0:19497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9600/0xbead52e175fc4572 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf7f expref: 15 pid: 19497 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869846.389559:0:19497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ff832e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19497:1875765554786944:192.168.201.30@tcp:104: 00000100:00100000:3.0:1788869846.389650:0:19497:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffaf01fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869846.398464:0:19497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ff832e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19497:1875765554786944:192.168.201.30@tcp:104: 00010000:00010000:3.0:1788869846.398495:0:19497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc45aa lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869846.400470:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869846.400595:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545283072 00000100:00100000:1.0:1788869846.400605:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545283072 00010000:00010000:1.0:1788869846.400650:0:17146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9600/0xbead52e175fc4572 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf7f expref: 16 pid: 19497 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869846.400696:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:1.0:1788869846.400706:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+16:2387:x1875765545283072:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869846.400735:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869846.400742:0:17146:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9600/0xbead52e175fc4572 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf7f expref: 16 pid: 19497 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.400756:0:17146:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9600/0xbead52e175fc4572 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf7f expref: 16 pid: 19497 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.400783:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9600/0xbead52e175fc4572 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf7f expref: 16 pid: 19497 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.400799:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99fe820c1f00) 00010000:00010000:1.0:1788869846.400805:0:17146:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc45aa lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.400816:0:17146:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc45aa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.400823:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc45aa lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.400857:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869846.400913:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+15:2387:x1875765545283072:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 207us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869846.400921:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00010000:00010000:2.0:1788869846.402341:0:19497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc45aa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.402357:0:19497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc45aa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788869846.402476:0:19497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1788869846.402599:0:19497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1788869846.402638:0:19497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1788869846.402731:0:19497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82326a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19497:1875765554787072:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788869846.402799:0:19497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869846.402855:0:19497:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb8b72d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869846.402926:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554787072 00000100:00100000:3.0:1788869846.402941:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554787072 00000100:00100000:3.0:1788869846.402996:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788869846.403004:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:19497:x1875765554787072:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788869846.403085:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:19497:x1875765554787072:12345-0@lo:1000:mdt00_003.0 Request processed in 82us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869846.403092:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788869846.403416:0:19497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82326a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19497:1875765554787072:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788869846.403567:0:19497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:2.0:1788869846.403608:0:19497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe82326a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19497:1875765554787200:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788869846.403636:0:19497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869846.403653:0:19497:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ff9553dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869846.403844:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554787200 00000100:00100000:3.0:1788869846.403856:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554787200 00000100:00100000:3.0:1788869846.403889:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788869846.403896:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19497:x1875765554787200:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788869846.404017:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:19497:x1875765554787200:12345-0@lo:1000:mdt00_003.0 Request processed in 122us (380us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788869846.404024:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788869846.404096:0:19497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe82326a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19497:1875765554787200:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788869846.404150:0:19497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc45aa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.404161:0:19497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc45aa lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.404174:0:19497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc45aa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.404181:0:19497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81534200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869846.404185:0:19497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc45aa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.404194:0:19497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc45aa lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.404210:0:19497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99fe820c1f00) 00010000:00010000:1.0:1788869846.404213:0:19497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869846.404217:0:19497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc45aa lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.404223:0:19497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81534200/0xbead52e175fc45aa lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.404279:0:19497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491400/0xbead52e175fc4502 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.404286:0:19497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491400/0xbead52e175fc4502 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.404292:0:19497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491400/0xbead52e175fc4502 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.404296:0:19497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81491400 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869846.404299:0:19497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491400/0xbead52e175fc4502 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.404315:0:19497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491400/0xbead52e175fc4502 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.404325:0:19497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:1.0:1788869846.404327:0:19497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869846.404334:0:19497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3a00/0xbead52e175fc4509 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf63 expref: 18 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.404346:0:19497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3a00/0xbead52e175fc4509 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf63 expref: 18 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.404354:0:19497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3a00/0xbead52e175fc4509 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf63 expref: 18 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.404406:0:19497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3a00/0xbead52e175fc4509 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf63 expref: 18 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869846.404418:0:19497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb45500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19497:1875765554787328:192.168.201.30@tcp:105: 00000100:00100000:1.0:1788869846.404485:0:19497:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ffb88c3480 going to sleep for 11 seconds 00000100:00100000:1.0:1788869846.407828:0:19497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb45500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19497:1875765554787328:192.168.201.30@tcp:105: 00010000:00010000:1.0:1788869846.407866:0:19497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491400/0xbead52e175fc4502 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.407878:0:19497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491400/0xbead52e175fc4502 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.407920:0:19497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc45b1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.408649:0:19497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc45b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.408665:0:19497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc45b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.408680:0:19497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc45b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.408687:0:19497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc45b1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.408693:0:19497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc45b1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.408699:0:19497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffb95a9200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869846.408703:0:19497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc45b1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.408711:0:19497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc45b1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.408723:0:19497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:1.0:1788869846.408726:0:19497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869846.408731:0:19497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc45b1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.408737:0:19497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc45b1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.408748:0:19497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc45a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.408763:0:19497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc45a3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.408769:0:19497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc45a3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.408773:0:19497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81535200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:1.0:1788869846.408776:0:19497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc45a3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.408782:0:19497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc45a3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.408790:0:19497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:1.0:1788869846.408792:0:19497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788869846.408795:0:19497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc45a3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.408800:0:19497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81535200/0xbead52e175fc45a3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869846.409050:0:19497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+18:15699:x1875765545282816:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 28942us (29307us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1788869846.409061:0:19497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 70 00000020:00080000:1.0:1788869846.409068:0:19497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788869846.412725:0:17196:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788869846.412736:0:17196:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869846.412757:0:17196:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788869846.412766:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788869846.413477:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869846.413644:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545283200 00000100:00100000:2.0:1788869846.413656:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545283200 00000100:00100000:2.0:1788869846.413723:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:2.0:1788869846.413738:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffbfb45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+18:15698:x1875765545283200:12345-192.168.201.30@tcp:49:bash.0 00000100:00100000:2.0:1788869846.413926:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffbfb45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+18:15698:x1875765545283200:12345-192.168.201.30@tcp:49:bash.0 Request processed in 192us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869846.413945:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1788869846.416429:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869846.424563:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545283456 00000100:00100000:2.0:1788869846.424581:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545283456 00000100:00100000:2.0:1788869846.424666:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:2.0:1788869846.424679:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+18:15699:x1875765545283456:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788869846.425034:0:17164:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788869846.425071:0:17164:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:2.0:1788869846.425110:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3600/0xbead52e175fc45b8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.425127:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3600/0xbead52e175fc45b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.425164:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3600/0xbead52e175fc45b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.425173:0:17164:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3600/0xbead52e175fc45b8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.425180:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3600/0xbead52e175fc45b8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.425187:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3600/0xbead52e175fc45b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.425208:0:17164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869846.425242:0:17149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869846.425248:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3600/0xbead52e175fc45b8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.425292:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ffba9f3600 already unused, calling callback (ffffffffc0bdb220) 00010000:00010000:2.0:1788869846.425297:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3600/0xbead52e175fc45b8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.425305:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3600/0xbead52e175fc45b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.425317:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99fe820c1f00) 00010000:00010000:2.0:1788869846.425320:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788869846.425325:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3600/0xbead52e175fc45b8 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.425332:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffba9f3600/0xbead52e175fc45b8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869846.425355:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869846.425357:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869846.425358:0:17149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869846.425446:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+20:15699:x1875765545283456:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 767us (9024us total) trans 8589934630 rc 0/0 00000100:00100000:2.0:1788869846.425455:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000020:00080000:2.0:1788869846.425461:0:17164:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788869846.426288:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869846.426313:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554787456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869846.426380:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869846.426442:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554787456 00000100:00100000:3.0:1788869846.426451:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554787456 00000100:00100000:3.0:1788869846.426524:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788869846.426533:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554787456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869846.426566:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788869846.426611:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875765554787456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869846.426618:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788869846.426639:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869846.426676:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875765554787456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869846.427370:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869846.427386:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554787584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869846.427429:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869846.427675:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3616:1875765554787712:0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.427713:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869846.427747:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554788224:0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.427780:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869846.427799:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffa5dc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554788736:0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.427826:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869846.427846:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788869846.427851:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554787840:0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.427876:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869846.427895:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffa5dc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554788352:0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.427922:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869846.429289:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffa5dc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875765554788864:0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.429340:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869846.429400:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554787712 00000100:00100000:0.0:1788869846.429408:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554787712 00000100:00100000:0.0:1788869846.429463:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788869846.429472:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:3616:x1875765554787712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.429563:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bcf8c69-1b38-4063-9d70-15b8a5835bb5+24:3616:x1875765554787712:12345-0@lo:400:kworker.0 Request processed in 91us (1848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869846.429571:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788869846.429626:0:17901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554788224 00000100:00100000:0.0:1788869846.429631:0:17901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554788224 00000100:00100000:0.0:1788869846.429656:0:17901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554787840 00000100:00100000:0.0:1788869846.429660:0:17901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554787840 00000100:00100000:0.0:1788869846.429674:0:17901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788869846.429680:0:17901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffa5dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554788224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.429717:0:17901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffa5dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554788224:12345-0@lo:400:kworker.0 Request processed in 37us (1937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869846.429724:0:17901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788869846.429737:0:17901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788869846.429743:0:17901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffa5dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554787840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.429770:0:17901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffa5dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875765554787840:12345-0@lo:400:kworker.0 Request processed in 28us (1894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869846.429775:0:17901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788869846.429800:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554787968:0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.429829:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869846.429848:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffa5dc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554788480:0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.429870:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869846.429885:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffa5dc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875765554788992:0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.429906:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869846.429925:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788869846.429931:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554788096:0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.429964:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869846.429979:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffa5dc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554788608:0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.429998:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869846.430009:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554789120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869846.430027:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869846.430054:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554787584 00000100:00100000:0.0:1788869846.430058:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554787584 00000100:00100000:0.0:1788869846.430077:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554789120 00000100:00100000:0.0:1788869846.430079:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554789120 00000100:00100000:0.0:1788869846.430097:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788869846.430102:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe81c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3618:x1875765554787584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869846.430126:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788869846.430196:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe81c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3618:x1875765554787584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (2767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869846.430202:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788869846.430214:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788869846.430219:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffa5dc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554789120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869846.430227:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788869846.430248:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffa5dc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554789120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869846.430273:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788869846.430316:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554789120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869846.430330:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554787584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869846.430364:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875765554787840:0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.430373:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bcf8c69-1b38-4063-9d70-15b8a5835bb5:3616:1875765554787712:0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.430392:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554788224:0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.430417:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554788352 00000100:00100000:0.0:1788869846.430420:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554788352 00000100:00100000:0.0:1788869846.430446:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554787968 00000100:00100000:0.0:1788869846.430449:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554787968 00000100:00100000:0.0:1788869846.430463:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788869846.430469:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffa5dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554788352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.430501:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffa5dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875765554788352:12345-0@lo:400:kworker.0 Request processed in 33us (2578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869846.430507:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788869846.430516:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788869846.430522:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffa5dc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554787968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.430547:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffa5dc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875765554787968:12345-0@lo:400:kworker.0 Request processed in 26us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869846.430553:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788869846.430582:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875765554787968:0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.430601:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffa5dc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875765554788352:0@lo:400:kworker.0 00000100:00100000:1.0:1788869846.430934:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554788736 00000100:00100000:1.0:1788869846.430940:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554788736 00000100:00100000:1.0:1788869846.430971:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554788864 00000100:00100000:1.0:1788869846.430973:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554788864 00000100:00100000:1.0:1788869846.430998:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554788480 00000100:00100000:1.0:1788869846.431001:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554788480 00000100:00100000:1.0:1788869846.431013:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554788992 00000100:00100000:1.0:1788869846.431016:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554788992 00000100:00100000:1.0:1788869846.431029:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554788096 00000100:00100000:1.0:1788869846.431032:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554788096 00000100:00100000:1.0:1788869846.431041:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554788608 00000100:00100000:1.0:1788869846.431043:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554788608 00000100:00100000:1.0:1788869846.431057:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788869846.431064:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffa5dc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554788736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869846.431127:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffa5dc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875765554788736:12345-0@lo:400:kworker.0 Request processed in 63us (3299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869846.431143:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788869846.431158:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788869846.431164:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffa5dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875765554788864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869846.431194:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffa5dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875765554788864:12345-0@lo:400:kworker.0 Request processed in 30us (1853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869846.431200:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788869846.431212:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788869846.431218:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffa5dc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554788480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869846.431278:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffa5dc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875765554788480:12345-0@lo:400:kworker.0 Request processed in 61us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869846.431285:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788869846.431313:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffa5dc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875765554788480:0@lo:400:kworker.0 00000100:00100000:1.0:1788869846.431332:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788869846.431338:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffa5dc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875765554788992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869846.431371:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffa5dc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875765554788992:12345-0@lo:400:kworker.0 Request processed in 33us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869846.431383:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1788869846.431411:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffa5dc5f80 x1875765554788992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869846.431423:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffa5dc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875765554788992:0@lo:400:kworker.0 00000100:00100000:1.0:1788869846.431445:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788869846.431453:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffa5dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554788096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869846.431493:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffa5dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875765554788096:12345-0@lo:400:kworker.0 Request processed in 41us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869846.431500:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788869846.431525:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99fe81c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875765554788096:0@lo:400:kworker.0 00000100:00100000:1.0:1788869846.431543:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788869846.431549:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffa5dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554788608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869846.431582:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffa5dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875765554788608:12345-0@lo:400:kworker.0 Request processed in 34us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869846.431588:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788869846.431628:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffa5dc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875765554788608:0@lo:400:kworker.0 00000100:00080000:3.0:1788869846.431963:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869846.431968:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869846.431971:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869846.431974:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869846.432359:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffa5dc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875765554788864:0@lo:400:kworker.0 00010000:00080000:0.0:1788869846.432378:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ffa5dc5880 x1875765554788736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869846.432389:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffa5dc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875765554788736:0@lo:400:kworker.0 00000100:00100000:3.0:1788869846.433444:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869846.435046:0:19702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545283584 00000100:00100000:0.0:1788869846.435058:0:19702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545283584 00000100:00100000:0.0:1788869846.435238:0:19702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:0.0:1788869846.435300:0:19702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+7:15698:x1875765545283584:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1788869846.435323:0:19702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869846.435349:0:19702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec999752/0xbead52e175fc45bf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaaf9b expref: -99 pid: 19702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788869846.435378:0:19702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9ffcd6, atime: 0x6a9ffcd4, ctime: 0x6a9ffcd6, blocks: 0x0 00010000:00010000:0.0:1788869846.435408:0:19702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788869846.435414:0:19702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869846.435424:0:19702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec999752/0xbead52e175fc45bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf9b expref: 8 pid: 19702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.435441:0:19702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ec999752/0xbead52e175fc45bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaaf9b expref: 8 pid: 19702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.435455:0:19702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ff81490800, rc 0) 00000100:00100000:0.0:1788869846.435531:0:19702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+8:15698:x1875765545283584:12345-192.168.201.30@tcp:101:bash.0 Request processed in 234us (2091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869846.435538:0:19702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:2.0:1788869846.445295:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869846.445368:0:19498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545283712 00000100:00100000:1.0:1788869846.445381:0:19498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545283712 00000100:00100000:1.0:1788869846.445450:0:19498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00100000:1.0:1788869846.445461:0:19498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+20:15698:x1875765545283712:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:1.0:1788869846.445489:0:19498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869846.445514:0:19498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc45c6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaafa2 expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.445573:0:19498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9e00/0xbead52e175fc45cd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.445589:0:19498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9e00/0xbead52e175fc45cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.445600:0:19498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9e00/0xbead52e175fc45cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.445720:0:19498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc45c6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaafa2 expref: 22 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.445740:0:19498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9e00/0xbead52e175fc45cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaafa2 expref: 21 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.445748:0:19498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:1.0:1788869846.445751:0:19498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788869846.445754:0:19498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a9e00, rc 0) 00000100:00100000:1.0:1788869846.445829:0:19498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b8a01ec-b40e-4f9d-b781-eccdb8771521+21:15698:x1875765545283712:12345-192.168.201.30@tcp:101:bash.0 Request processed in 370us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869846.445836:0:19498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00100000:2.0:1788869846.460294:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869846.469507:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545283968 00000100:00100000:0.0:1788869846.469526:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545283968 00000100:00100000:0.0:1788869846.469599:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:0.0:1788869846.469611:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+21:15698:x1875765545283968:12345-192.168.201.30@tcp:35:bash.0 00000001:00080000:0.0:1788869846.471978:0:17164:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:0.0:1788869846.472154:0:17164:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:0.0:1788869846.472340:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b8a01ec-b40e-4f9d-b781-eccdb8771521+24:15698:x1875765545283968:12345-192.168.201.30@tcp:35:bash.0 Request processed in 2723us (12050us total) trans 8589934633 rc 0/0 00000100:00100000:0.0:1788869846.472363:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00000020:00080000:0.0:1788869846.472370:0:17164:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788869846.606555:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869846.606620:0:19497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545284224 00000100:00100000:1.0:1788869846.606631:0:19497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545284224 00000100:00100000:1.0:1788869846.606735:0:19497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:1.0:1788869846.606746:0:19497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+24:15709:x1875765545284224:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1788869846.606772:0:19497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869846.606795:0:19497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc45d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc7c9157fffaafa9 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869846.606917:0:19497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788869846.607042:0:19497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc45d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaafa9 expref: 26 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.607058:0:19497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99fe831e6e00) 00010000:00010000:1.0:1788869846.607061:0:19497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869846.607066:0:19497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ffb95a9200/0xbead52e175fc45d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xbc7c9157fffaafa9 expref: 26 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869846.607081:0:19497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ffb95a9200, rc 0) 00000100:00100000:1.0:1788869846.607151:0:19497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+25:15709:x1875765545284224:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 406us (601us total) trans 8589934634 rc 301/301 00000100:00100000:1.0:1788869846.607159:0:19497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:2.0:1788869846.611409:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1788869846.611584:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545284352 00000100:00100000:0.0:1788869846.611596:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545284352 00000100:00100000:0.0:1788869846.611667:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00100000:0.0:1788869846.611677:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+25:15709:x1875765545284352:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:0.0:1788869846.611752:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490a00/0xbead52e175fc45e2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.611766:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490a00/0xbead52e175fc45e2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.611775:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490a00/0xbead52e175fc45e2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.611784:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491200/0xbead52e175fc45e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.611789:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491200/0xbead52e175fc45e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.611793:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491200/0xbead52e175fc45e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.611962:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490e00/0xbead52e175fc45f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.611971:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490e00/0xbead52e175fc45f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.611979:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490e00/0xbead52e175fc45f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869846.612045:0:17160:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490e00/0xbead52e175fc45f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.612058:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490a00/0xbead52e175fc45e2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.612063:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490a00/0xbead52e175fc45e2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.612067:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490a00/0xbead52e175fc45e2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.612071:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81490a00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869846.612074:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490a00/0xbead52e175fc45e2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.612078:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490a00/0xbead52e175fc45e2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.612087:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99fe81f9b400) 00010000:00010000:0.0:1788869846.612088:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869846.612091:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490a00/0xbead52e175fc45e2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.612095:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490a00/0xbead52e175fc45e2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.612105:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491200/0xbead52e175fc45e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.612111:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491200/0xbead52e175fc45e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.612124:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491200/0xbead52e175fc45e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.612139:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81491200 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869846.612142:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491200/0xbead52e175fc45e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.612149:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491200/0xbead52e175fc45e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.612158:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff99fe81f9b700) 00010000:00010000:0.0:1788869846.612160:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869846.612163:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491200/0xbead52e175fc45e9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.612170:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81491200/0xbead52e175fc45e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.612187:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490e00/0xbead52e175fc45f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.612191:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490e00/0xbead52e175fc45f0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.612196:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490e00/0xbead52e175fc45f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.612198:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ff81490e00 already unused, calling callback (ffffffffc17d84f0) 00010000:00010000:0.0:1788869846.612200:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490e00/0xbead52e175fc45f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.612212:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490e00/0xbead52e175fc45f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.612218:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99ffb89e0000) 00010000:00010000:0.0:1788869846.612219:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869846.612222:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490e00/0xbead52e175fc45f0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869846.612225:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ff81490e00/0xbead52e175fc45f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869846.612331:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+25:15709:x1875765545284352:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 655us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869846.612339:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00100000:2.0:1788869846.614900:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1788869846.615036:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545284608 00000100:00100000:1.0:1788869846.615046:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545284608 00000100:00100000:1.0:1788869846.615220:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:1.0:1788869846.615233:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+25:15709:x1875765545284608:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:1.0:1788869846.615682:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b8a01ec-b40e-4f9d-b781-eccdb8771521+26:15709:x1875765545284608:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 451us (866us total) trans 8589934635 rc 0/0 00000100:00100000:1.0:1788869846.615690:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00010000:00010000:3.0:1788869846.872476:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869847.897167:0:19701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788869848.210742:0:20340:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:2.0:1788869848.920540:0:19700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869848.985977:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869848.986008:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ffbfb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554789248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869848.986077:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869848.986203:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765554789248 00000100:00100000:0.0:1788869848.986210:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765554789248 00000100:00100000:0.0:1788869848.986300:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788869848.986312:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ff832e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554789248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788869848.986346:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788869848.986403:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ff832e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875765554789248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869848.986409:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788869848.986511:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ffbfb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875765554789248:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788869848.986573:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869849.195766:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869849.195796:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869849.195813:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869849.195825:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869849.195842:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869849.195852:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869849.195866:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869849.195885:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869849.195900:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1788869849.195922:0:19497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545284864 00000100:00100000:2.0:1788869849.195939:0:19497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545284864 00000100:00100000:2.0:1788869849.195992:0:19497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545285376 00000100:00100000:2.0:1788869849.195995:0:19497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545285376 00000100:00100000:2.0:1788869849.196009:0:19497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545284992 00000100:00100000:2.0:1788869849.196011:0:19497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545284992 00000100:00100000:2.0:1788869849.196022:0:19497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545285504 00000100:00100000:2.0:1788869849.196024:0:19497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545285504 00000100:00100000:2.0:1788869849.196039:0:19497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:2.0:1788869849.196048:0:19497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+26:2390:x1875765545284864:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869849.196139:0:19497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+26:2390:x1875765545284864:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 91us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869849.196146:0:19497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:2.0:1788869849.196176:0:19497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:2.0:1788869849.196183:0:19497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31cd0bfc-dd3a-4c19-9441-01049d848740+6:2390:x1875765545285376:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869849.196214:0:19497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31cd0bfc-dd3a-4c19-9441-01049d848740+6:2390:x1875765545285376:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869849.196219:0:19497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:2.0:1788869849.196227:0:19497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:2.0:1788869849.196231:0:19497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+5:2390:x1875765545284992:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869849.196246:0:19497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b8a01ec-b40e-4f9d-b781-eccdb8771521+5:2390:x1875765545284992:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 15us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869849.196274:0:19497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:2.0:1788869849.196282:0:19497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:2.0:1788869849.196286:0:19497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31cd0bfc-dd3a-4c19-9441-01049d848740+5:2390:x1875765545285504:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1788869849.196299:0:19497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31cd0bfc-dd3a-4c19-9441-01049d848740+5:2390:x1875765545285504:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 14us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869849.196310:0:19497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:0.0:1788869849.196585:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545285120 00000100:00100000:0.0:1788869849.196589:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545285120 00000100:00100000:0.0:1788869849.196618:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545285632 00000100:00100000:0.0:1788869849.196620:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545285632 00000100:00100000:0.0:1788869849.196629:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545285248 00000100:00100000:0.0:1788869849.196631:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545285248 00000100:00100000:0.0:1788869849.196639:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545285760 00000100:00100000:0.0:1788869849.196646:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545285760 00000100:00100000:0.0:1788869849.196659:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:0.0:1788869849.196663:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+8:2390:x1875765545285120:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869849.196687:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+8:2390:x1875765545285120:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869849.196691:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:0.0:1788869849.196699:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:0.0:1788869849.196703:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31cd0bfc-dd3a-4c19-9441-01049d848740+5:2390:x1875765545285632:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869849.196715:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31cd0bfc-dd3a-4c19-9441-01049d848740+5:2390:x1875765545285632:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 13us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869849.196718:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:0.0:1788869849.196723:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:0.0:1788869849.196727:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+5:2390:x1875765545285248:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869849.196742:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b8a01ec-b40e-4f9d-b781-eccdb8771521+5:2390:x1875765545285248:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 15us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869849.196745:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:0.0:1788869849.196750:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:0.0:1788869849.196754:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99fe82325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31cd0bfc-dd3a-4c19-9441-01049d848740+5:2390:x1875765545285760:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1788869849.196774:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99fe82325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31cd0bfc-dd3a-4c19-9441-01049d848740+5:2390:x1875765545285760:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 19us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869849.196780:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:3.0:1788869849.197426:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765545284736 00000100:00100000:3.0:1788869849.197431:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875765545284736 00000100:00100000:3.0:1788869849.197495:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 166 00000100:00100000:3.0:1788869849.197501:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ffb9abd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:2390:x1875765545284736:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1788869849.197534:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ffb9abd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e10bffde-eac0-4cc8-9215-f0ed84a241b8+13:2390:x1875765545284736:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 35us (1692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869849.197539:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 166 00000100:00080000:3.0:1788869849.197565:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869849.197569:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869849.197571:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869849.197573:0:17156:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 Debug log: 42592 lines, 42592 kept, 0 dropped, 0 bad.